Test Report: Docker_Linux_containerd 12425

                    
                      07c6aa0a52dfb95e89e99689c8f3f45bf5722157:2021-09-15:20483
                    
                

Test fail (5/274)

Order failed test Duration
202 TestDebPackageInstall/install_amd64_ubuntu_18.04/kvm2-driver 83.21
205 TestScheduledStopUnix 90.93
228 TestPause/serial/Pause 15.26
236 TestPause/serial/VerifyStatus 2.78
238 TestPause/serial/PauseAgain 6.51
x
+
TestDebPackageInstall/install_amd64_ubuntu_18.04/kvm2-driver (83.21s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_ubuntu_18.04/kvm2-driver
pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp ubuntu:18.04 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"
pkg_install_test.go:106: (dbg) Non-zero exit: docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp ubuntu:18.04 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": signal: killed (1m23.207127741s)

                                                
                                                
-- stdout --
	Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
	Get:2 http://archive.ubuntu.com/ubuntu bionic InRelease [242 kB]
	Get:3 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1428 kB]
	Get:4 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [567 kB]
	Get:5 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [26.7 kB]
	Get:6 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [2324 kB]
	Get:7 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
	Get:8 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
	Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 Packages [1344 kB]
	Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 Packages [11.3 MB]
	Get:11 http://archive.ubuntu.com/ubuntu bionic/multiverse amd64 Packages [186 kB]
	Get:12 http://archive.ubuntu.com/ubuntu bionic/restricted amd64 Packages [13.5 kB]
	Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [2760 kB]
	Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [2202 kB]
	Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [34.4 kB]
	Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [600 kB]
	Get:17 http://archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [11.3 kB]
	Get:18 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [11.4 kB]
	Fetched 23.3 MB in 1min 12s (324 kB/s)
	Reading package lists...
	Reading package lists...
	Building dependency tree...
	Reading state information...
	The following additional packages will be installed:
	  ca-certificates dbus dmeventd dmsetup krb5-locales libapparmor1
	  libasn1-8-heimdal libavahi-client3 libavahi-common-data libavahi-common3
	  libcurl3-gnutls libdbus-1-3 libdevmapper-event1.02.1 libdevmapper1.02.1
	  libexpat1 libgssapi-krb5-2 libgssapi3-heimdal libhcrypto4-heimdal
	  libheimbase1-heimdal libheimntlm0-heimdal libhx509-5-heimdal libicu60
	  libk5crypto3 libkeyutils1 libkrb5-26-heimdal libkrb5-3 libkrb5support0
	  libldap-2.4-2 libldap-common liblvm2app2.2 liblvm2cmd2.02 libnghttp2-14
	  libnl-3-200 libnuma1 libpsl5 libreadline5 libroken18-heimdal librtmp1
	  libsasl2-2 libsasl2-modules libsasl2-modules-db libsqlite3-0 libssl1.1
	  libwind0-heimdal libxml2 libyajl2 lvm2 openssl publicsuffix readline-common
	Suggested packages:
	  default-dbus-session-bus | dbus-session-bus krb5-doc krb5-user
	  libsasl2-modules-gssapi-mit | libsasl2-modules-gssapi-heimdal
	  libsasl2-modules-ldap libsasl2-modules-otp libsasl2-modules-sql
	  thin-provisioning-tools readline-doc
	The following NEW packages will be installed:
	  ca-certificates dbus dmeventd dmsetup krb5-locales libapparmor1
	  libasn1-8-heimdal libavahi-client3 libavahi-common-data libavahi-common3
	  libcurl3-gnutls libdbus-1-3 libdevmapper-event1.02.1 libdevmapper1.02.1
	  libexpat1 libgssapi-krb5-2 libgssapi3-heimdal libhcrypto4-heimdal
	  libheimbase1-heimdal libheimntlm0-heimdal libhx509-5-heimdal libicu60
	  libk5crypto3 libkeyutils1 libkrb5-26-heimdal libkrb5-3 libkrb5support0
	  libldap-2.4-2 libldap-common liblvm2app2.2 liblvm2cmd2.02 libnghttp2-14
	  libnl-3-200 libnuma1 libpsl5 libreadline5 libroken18-heimdal librtmp1
	  libsasl2-2 libsasl2-modules libsasl2-modules-db libsqlite3-0 libssl1.1
	  libvirt0 libwind0-heimdal libxml2 libyajl2 lvm2 openssl publicsuffix
	  readline-common
	0 upgraded, 51 newly installed, 0 to remove and 24 not upgraded.
	Need to get 17.6 MB of archives.
	After this operation, 64.0 MB of additional disk space will be used.
	Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl1.1 amd64 1.1.1-1ubuntu2.1~18.04.13 [1302 kB]
	Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 openssl amd64 1.1.1-1ubuntu2.1~18.04.13 [614 kB]
	Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 ca-certificates all 20210119~18.04.1 [147 kB]
	Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapparmor1 amd64 2.12-4ubuntu5.1 [31.3 kB]
	Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libdbus-1-3 amd64 1.12.2-1ubuntu1.2 [175 kB]
	Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libexpat1 amd64 2.2.5-3ubuntu0.2 [80.5 kB]
	Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 dbus amd64 1.12.2-1ubuntu1.2 [150 kB]
	Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libdevmapper1.02.1 amd64 2:1.02.145-4.1ubuntu3.18.04.3 [127 kB]
	Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 dmsetup amd64 2:1.02.145-4.1ubuntu3.18.04.3 [74.4 kB]
	Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libicu60 amd64 60.2-3ubuntu3.1 [8054 kB]

                                                
                                                
-- /stdout --
pkg_install_test.go:89: failed to install "/home/jenkins/workspace/Docker_Linux_containerd_integration/out/docker-machine-driver-kvm2_1.23.0-0_amd64.deb" on "ubuntu:18.04": err=signal: killed, exit=-1
--- FAIL: TestDebPackageInstall/install_amd64_ubuntu_18.04/kvm2-driver (83.21s)

                                                
                                    
x
+
TestScheduledStopUnix (90.93s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:129: (dbg) Run:  out/minikube-linux-amd64 start -p scheduled-stop-20210915191532-498219 --memory=2048 --driver=docker  --container-runtime=containerd
scheduled_stop_test.go:129: (dbg) Done: out/minikube-linux-amd64 start -p scheduled-stop-20210915191532-498219 --memory=2048 --driver=docker  --container-runtime=containerd: (44.926592995s)
scheduled_stop_test.go:138: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20210915191532-498219 --schedule 5m
scheduled_stop_test.go:192: (dbg) Run:  out/minikube-linux-amd64 status --format={{.TimeToStop}} -p scheduled-stop-20210915191532-498219 -n scheduled-stop-20210915191532-498219
scheduled_stop_test.go:170: signal error was:  <nil>
scheduled_stop_test.go:138: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20210915191532-498219 --schedule 8s
scheduled_stop_test.go:170: signal error was:  os: process already finished
scheduled_stop_test.go:138: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20210915191532-498219 --cancel-scheduled
scheduled_stop_test.go:177: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-20210915191532-498219 -n scheduled-stop-20210915191532-498219
scheduled_stop_test.go:206: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-20210915191532-498219
scheduled_stop_test.go:138: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20210915191532-498219 --schedule 5s
scheduled_stop_test.go:170: signal error was:  os: process already finished
scheduled_stop_test.go:206: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-20210915191532-498219
scheduled_stop_test.go:206: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p scheduled-stop-20210915191532-498219: exit status 3 (1.922668176s)

                                                
                                                
-- stdout --
	scheduled-stop-20210915191532-498219
	type: Control Plane
	host: Error
	kubelet: Nonexistent
	apiserver: Nonexistent
	kubeconfig: Configured
	

                                                
                                                
-- /stdout --
** stderr ** 
	E0915 19:16:58.241362  617104 status.go:374] failed to get storage capacity of /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	E0915 19:16:58.241417  617104 status.go:258] status error: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

                                                
                                                
** /stderr **
scheduled_stop_test.go:210: minikube status: exit status 3

                                                
                                                
-- stdout --
	scheduled-stop-20210915191532-498219
	type: Control Plane
	host: Error
	kubelet: Nonexistent
	apiserver: Nonexistent
	kubeconfig: Configured
	

                                                
                                                
-- /stdout --
** stderr ** 
	E0915 19:16:58.241362  617104 status.go:374] failed to get storage capacity of /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	E0915 19:16:58.241417  617104 status.go:258] status error: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

                                                
                                                
** /stderr **
panic.go:642: *** TestScheduledStopUnix FAILED at 2021-09-15 19:16:58.243734929 +0000 UTC m=+2132.708464476
helpers_test.go:223: -----------------------post-mortem--------------------------------
helpers_test.go:231: ======>  post-mortem[TestScheduledStopUnix]: docker inspect <======
helpers_test.go:232: (dbg) Run:  docker inspect scheduled-stop-20210915191532-498219
helpers_test.go:236: (dbg) docker inspect scheduled-stop-20210915191532-498219:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "2d465277dcde526c7ceacdb895353a893f061ba412f7fa1c020898f3cff58f2a",
	        "Created": "2021-09-15T19:15:34.507233235Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "exited",
	            "Running": false,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 0,
	            "ExitCode": 137,
	            "Error": "",
	            "StartedAt": "2021-09-15T19:15:34.997037061Z",
	            "FinishedAt": "2021-09-15T19:16:56.556294051Z"
	        },
	        "Image": "sha256:83b5a81388468b1ffcd3874b4f24c1406c63c33ac07797cc8bed6ad0207d36a8",
	        "ResolvConfPath": "/var/lib/docker/containers/2d465277dcde526c7ceacdb895353a893f061ba412f7fa1c020898f3cff58f2a/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/2d465277dcde526c7ceacdb895353a893f061ba412f7fa1c020898f3cff58f2a/hostname",
	        "HostsPath": "/var/lib/docker/containers/2d465277dcde526c7ceacdb895353a893f061ba412f7fa1c020898f3cff58f2a/hosts",
	        "LogPath": "/var/lib/docker/containers/2d465277dcde526c7ceacdb895353a893f061ba412f7fa1c020898f3cff58f2a/2d465277dcde526c7ceacdb895353a893f061ba412f7fa1c020898f3cff58f2a-json.log",
	        "Name": "/scheduled-stop-20210915191532-498219",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "scheduled-stop-20210915191532-498219:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "scheduled-stop-20210915191532-498219",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "Capabilities": null,
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 0,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [
	                {
	                    "PathOnHost": "/dev/fuse",
	                    "PathInContainer": "/dev/fuse",
	                    "CgroupPermissions": "rwm"
	                }
	            ],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 0,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/47a13d3ba3dfe8b9c57ab00ef477fa93ea27ea4470c9e405a68fdf7633dba39e-init/diff:/var/lib/docker/overlay2/0f8a10c746fedd8d666b9dae9bdd481a4ecb3bdc1c19c1763f5067cb6f6ec480/diff:/var/lib/docker/overlay2/f54dd51211f7fd37ed9e7e1b70117531d83c45068e0d908bb274324aaab9559e/diff:/var/lib/docker/overlay2/db8bcdf3259b37def0e8daacd8a4b91582e91b1335c4898bead8f0570ee379f4/diff:/var/lib/docker/overlay2/38faf25fee6b5c923ea643302bba2da4194356f1ecd1442a2371c90afb025b10/diff:/var/lib/docker/overlay2/c4a1a3e49e5edffd417be1158a98868c52bdfc84e62524f2c795e427d987e984/diff:/var/lib/docker/overlay2/e68c2d7fd8912bc6f5e5c4fd63053076de99a4d27b5ac2d087e97b170c724fbd/diff:/var/lib/docker/overlay2/c74734152182eae7a2408058cc612acaac307696039525cbf809638bdc5f0291/diff:/var/lib/docker/overlay2/871cb5ebce097dd4aeeed897eae2f2516c492acd2cf20e22a9bd621400d03fab/diff:/var/lib/docker/overlay2/c6de31e81e924f091a3674cc807ae856aaaf0bd75eede35b8012e555a78482f8/diff:/var/lib/docker/overlay2/5cb89b
dcb371bd4714cf4cc592534e708077fc8ba74ac5611767920d2e72b515/diff:/var/lib/docker/overlay2/855cba59b338da688aa696b251e03ec2f0d9dc95537b26265f31042b64dbcc2d/diff:/var/lib/docker/overlay2/68e4b369a0e1b1a42b5b9874ee9fa0849598643096f78bd2ff9f86e7f0dee281/diff:/var/lib/docker/overlay2/7d9c9be2ec55a3cfaeb8e493bde1f09d3e07500aa41b31d9dc92e3a045bfaa88/diff:/var/lib/docker/overlay2/e229f9da50c177e6addfce418c74667438f518d5821a0f714cb58a3968830c71/diff:/var/lib/docker/overlay2/ef41fa20aaf0f3e8b0f0873abea368bc5dfaf6684783ca409e3d6dfa74ca2b33/diff:/var/lib/docker/overlay2/8160677224d3d0ba75ceac5e22adbe4420f58aa9df575a4fa1eb16cfa5d36cb1/diff:/var/lib/docker/overlay2/747c3fc9ab1ea2616d662bd3b2e2f1ddbdac907a6eea86ac017e9ce3e66dc4d9/diff:/var/lib/docker/overlay2/f8eb124418298912c3691320300767eabaeae37f352f56c2d0e5a40dd97b0bc2/diff:/var/lib/docker/overlay2/c37f4c78c3026a8785fb4aca9fa78dc5ac21307cb3bfbf746bacec078e037770/diff:/var/lib/docker/overlay2/ee71c4960738cdf41b558b5aa16215f18299ecf0b241560a77477f080674ba8c/diff:/var/lib/d
ocker/overlay2/f2132a0cc49a4383ce675ba6870120bd2c58077afad82ab90d066c0651128e1d/diff:/var/lib/docker/overlay2/44200c5ed83b044737127b23b0b15c55e21152acc08ba98910e0dcb93835c4d5/diff:/var/lib/docker/overlay2/22bce5e99989e32cb7a1f876e412e03427623b5cb70e4709d0336c2cae5f4b37/diff:/var/lib/docker/overlay2/ccfb925585c3768c7aba8e731873849181bedce4d441b3095c1abfd310c405e1/diff:/var/lib/docker/overlay2/a90553cf4067ab91ee5ed23daf5f3aab785ded168917688d3c11e7eb856cc869/diff:/var/lib/docker/overlay2/dc493bca572baf2fff7143d6c551dc24acb22082e51a68200466da7510d37550/diff:/var/lib/docker/overlay2/e4fdd0a7dd5c09a7507c2e66bb44972d2db20fd3c58d2191eaa45291e1a47321/diff:/var/lib/docker/overlay2/4badf8f702a906675401fab2bb8327dafc5e0098b8a40e8ae31d3f4337c5539e/diff:/var/lib/docker/overlay2/d7a568f51d57ee1283764757ae3c91db612a7acb01906d88f7321359f27d4dcb/diff:/var/lib/docker/overlay2/123e8c40e6520b691981a6af80c211632618f36cb297ef8a28376985e8b9eddf/diff:/var/lib/docker/overlay2/fcfefbd58c332906200403538c8d881d31cbd97ecd5a2e223b198713731
51469/diff:/var/lib/docker/overlay2/a9e5b72b4ba31d329ac284cad558db42f24197775aaabfd188f2846a0a4ce96d/diff:/var/lib/docker/overlay2/7916e1ed717fc8628e14637400ba911d6e64209e501841613f69224c999b54f8/diff:/var/lib/docker/overlay2/3c121fd6f387f06c1b3a211eb1d7db64ffd333a873146a734de241e936ab5322/diff:/var/lib/docker/overlay2/9958539b4278fcc1c310de22689891aba5f238a94351d3c645b9dacba922241b/diff:/var/lib/docker/overlay2/c6c60f0d02b1e1aad2ea4fa1fb017d98e1ca4602689452dbd721342c0927fc6a/diff:/var/lib/docker/overlay2/e61aabb9eb2161801d4795e4a00f41afd54c504a52aeeef70d49d2a4f47fcd99/diff:/var/lib/docker/overlay2/a69e80d9160e6158cf9f37881d60928bf3221341b1fffe8d2855488233278102/diff:/var/lib/docker/overlay2/f76fd1ba3588d22f5228ab597df7a62e20a79217c1712dbc33e20061e12891c6/diff",
	                "MergedDir": "/var/lib/docker/overlay2/47a13d3ba3dfe8b9c57ab00ef477fa93ea27ea4470c9e405a68fdf7633dba39e/merged",
	                "UpperDir": "/var/lib/docker/overlay2/47a13d3ba3dfe8b9c57ab00ef477fa93ea27ea4470c9e405a68fdf7633dba39e/diff",
	                "WorkDir": "/var/lib/docker/overlay2/47a13d3ba3dfe8b9c57ab00ef477fa93ea27ea4470c9e405a68fdf7633dba39e/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "scheduled-stop-20210915191532-498219",
	                "Source": "/var/lib/docker/volumes/scheduled-stop-20210915191532-498219/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "scheduled-stop-20210915191532-498219",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "scheduled-stop-20210915191532-498219",
	                "name.minikube.sigs.k8s.io": "scheduled-stop-20210915191532-498219",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "1a0320355745eb11a8e7573edd48cf71f97e7e0ed54972486ac673bbcd5a0491",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {},
	            "SandboxKey": "/var/run/docker/netns/1a0320355745",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "scheduled-stop-20210915191532-498219": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "2d465277dcde"
	                    ],
	                    "NetworkID": "611ac8790b51401c5f9827adc8cdafa9523a6e61f1a3d38a9ac2632e3534532f",
	                    "EndpointID": "",
	                    "Gateway": "",
	                    "IPAddress": "",
	                    "IPPrefixLen": 0,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-20210915191532-498219 -n scheduled-stop-20210915191532-498219
helpers_test.go:240: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-20210915191532-498219 -n scheduled-stop-20210915191532-498219: exit status 7 (91.934295ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:240: status error: exit status 7 (may be ok)
helpers_test.go:242: "scheduled-stop-20210915191532-498219" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:176: Cleaning up "scheduled-stop-20210915191532-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p scheduled-stop-20210915191532-498219
helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p scheduled-stop-20210915191532-498219: (5.46371714s)
--- FAIL: TestScheduledStopUnix (90.93s)

                                                
                                    
x
+
TestPause/serial/Pause (15.26s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:108: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-20210915191717-498219 --alsologtostderr -v=5

                                                
                                                
=== CONT  TestPause/serial/Pause
pause_test.go:108: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p pause-20210915191717-498219 --alsologtostderr -v=5: exit status 80 (9.078616657s)

                                                
                                                
-- stdout --
	* Pausing node pause-20210915191717-498219 ... 
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0915 19:22:53.096654  658937 out.go:298] Setting OutFile to fd 1 ...
	I0915 19:22:53.096756  658937 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:22:53.096765  658937 out.go:311] Setting ErrFile to fd 2...
	I0915 19:22:53.096771  658937 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:22:53.096906  658937 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	I0915 19:22:53.097125  658937 out.go:305] Setting JSON to false
	I0915 19:22:53.097151  658937 mustload.go:65] Loading cluster: pause-20210915191717-498219
	I0915 19:22:53.097534  658937 config.go:177] Loaded profile config "pause-20210915191717-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 19:22:53.098076  658937 cli_runner.go:115] Run: docker container inspect pause-20210915191717-498219 --format={{.State.Status}}
	I0915 19:22:53.154188  658937 host.go:66] Checking if "pause-20210915191717-498219" exists ...
	I0915 19:22:53.154608  658937 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 19:22:53.263642  658937 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:46 OomKillDisable:true NGoroutines:50 SystemTime:2021-09-15 19:22:53.205170801 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 19:22:53.265880  658937 pause.go:58] "namespaces" [kube-system kubernetes-dashboard storage-gluster istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cni: container-runtime:docker cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) host-dns-resolver:%!s(bool=
true) host-only-cidr:192.168.99.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/12425/minikube-v1.23.0-1631662909-12425.iso https://github.com/kubernetes/minikube/releases/download/v1.23.0-1631662909-12425/minikube-v1.23.0-1631662909-12425.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.23.0-1631662909-12425.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qemu-uri:qemu:///system listen-address: memory: mount:%!s(bool=false) mount-string:/home/jenkins:/minikube-host namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plu
gin: nfs-share:[] nfs-shares-root:/nfsshares no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:pause-20210915191717-498219 purge:%!s(bool=false) registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) schedule:0s service-cluster-ip-range:10.96.0.0/12 ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true) wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"
	I0915 19:22:53.268199  658937 out.go:177] * Pausing node pause-20210915191717-498219 ... 
	I0915 19:22:53.268232  658937 host.go:66] Checking if "pause-20210915191717-498219" exists ...
	I0915 19:22:53.268552  658937 ssh_runner.go:152] Run: systemctl --version
	I0915 19:22:53.268603  658937 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20210915191717-498219
	I0915 19:22:53.319229  658937 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33158 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/pause-20210915191717-498219/id_rsa Username:docker}
	I0915 19:22:53.399818  658937 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
	I0915 19:22:53.410154  658937 pause.go:50] kubelet running: true
	I0915 19:22:53.410223  658937 ssh_runner.go:152] Run: sudo systemctl disable --now kubelet
	I0915 19:22:53.542459  658937 retry.go:31] will retry after 276.165072ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1
	stdout:
	
	stderr:
	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install disable kubelet
	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.
	I0915 19:22:53.818889  658937 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
	I0915 19:22:53.828512  658937 pause.go:50] kubelet running: true
	I0915 19:22:53.828568  658937 ssh_runner.go:152] Run: sudo systemctl disable --now kubelet
	I0915 19:22:53.938723  658937 retry.go:31] will retry after 540.190908ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1
	stdout:
	
	stderr:
	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install disable kubelet
	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.
	I0915 19:22:54.479425  658937 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
	I0915 19:22:54.489157  658937 pause.go:50] kubelet running: true
	I0915 19:22:54.489222  658937 ssh_runner.go:152] Run: sudo systemctl disable --now kubelet
	I0915 19:22:54.589375  658937 retry.go:31] will retry after 655.06503ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1
	stdout:
	
	stderr:
	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install disable kubelet
	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.
	I0915 19:22:55.245203  658937 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
	I0915 19:22:55.256347  658937 pause.go:50] kubelet running: true
	I0915 19:22:55.256415  658937 ssh_runner.go:152] Run: sudo systemctl disable --now kubelet
	I0915 19:22:56.710258  658937 out.go:177] 
	W0915 19:22:56.710491  658937 out.go:242] X Exiting due to GUEST_PAUSE: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1
	stdout:
	
	stderr:
	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install disable kubelet
	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.
	
	X Exiting due to GUEST_PAUSE: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1
	stdout:
	
	stderr:
	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install disable kubelet
	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.
	
	W0915 19:22:56.710523  658937 out.go:242] * 
	* 
	W0915 19:22:56.725054  658937 out.go:242] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_1.log                   │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_1.log                   │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0915 19:23:02.111115  658937 out.go:177] 

                                                
                                                
** /stderr **
pause_test.go:110: failed to pause minikube with args: "out/minikube-linux-amd64 pause -p pause-20210915191717-498219 --alsologtostderr -v=5" : exit status 80
helpers_test.go:223: -----------------------post-mortem--------------------------------
helpers_test.go:231: ======>  post-mortem[TestPause/serial/Pause]: docker inspect <======
helpers_test.go:232: (dbg) Run:  docker inspect pause-20210915191717-498219
helpers_test.go:236: (dbg) docker inspect pause-20210915191717-498219:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74",
	        "Created": "2021-09-15T19:20:44.739194513Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 639632,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2021-09-15T19:20:45.450816177Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:83b5a81388468b1ffcd3874b4f24c1406c63c33ac07797cc8bed6ad0207d36a8",
	        "ResolvConfPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/hostname",
	        "HostsPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/hosts",
	        "LogPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74-json.log",
	        "Name": "/pause-20210915191717-498219",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "pause-20210915191717-498219:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "pause-20210915191717-498219",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "Capabilities": null,
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 0,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [
	                {
	                    "PathOnHost": "/dev/fuse",
	                    "PathInContainer": "/dev/fuse",
	                    "CgroupPermissions": "rwm"
	                }
	            ],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 0,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e-init/diff:/var/lib/docker/overlay2/0f8a10c746fedd8d666b9dae9bdd481a4ecb3bdc1c19c1763f5067cb6f6ec480/diff:/var/lib/docker/overlay2/f54dd51211f7fd37ed9e7e1b70117531d83c45068e0d908bb274324aaab9559e/diff:/var/lib/docker/overlay2/db8bcdf3259b37def0e8daacd8a4b91582e91b1335c4898bead8f0570ee379f4/diff:/var/lib/docker/overlay2/38faf25fee6b5c923ea643302bba2da4194356f1ecd1442a2371c90afb025b10/diff:/var/lib/docker/overlay2/c4a1a3e49e5edffd417be1158a98868c52bdfc84e62524f2c795e427d987e984/diff:/var/lib/docker/overlay2/e68c2d7fd8912bc6f5e5c4fd63053076de99a4d27b5ac2d087e97b170c724fbd/diff:/var/lib/docker/overlay2/c74734152182eae7a2408058cc612acaac307696039525cbf809638bdc5f0291/diff:/var/lib/docker/overlay2/871cb5ebce097dd4aeeed897eae2f2516c492acd2cf20e22a9bd621400d03fab/diff:/var/lib/docker/overlay2/c6de31e81e924f091a3674cc807ae856aaaf0bd75eede35b8012e555a78482f8/diff:/var/lib/docker/overlay2/5cb89b
dcb371bd4714cf4cc592534e708077fc8ba74ac5611767920d2e72b515/diff:/var/lib/docker/overlay2/855cba59b338da688aa696b251e03ec2f0d9dc95537b26265f31042b64dbcc2d/diff:/var/lib/docker/overlay2/68e4b369a0e1b1a42b5b9874ee9fa0849598643096f78bd2ff9f86e7f0dee281/diff:/var/lib/docker/overlay2/7d9c9be2ec55a3cfaeb8e493bde1f09d3e07500aa41b31d9dc92e3a045bfaa88/diff:/var/lib/docker/overlay2/e229f9da50c177e6addfce418c74667438f518d5821a0f714cb58a3968830c71/diff:/var/lib/docker/overlay2/ef41fa20aaf0f3e8b0f0873abea368bc5dfaf6684783ca409e3d6dfa74ca2b33/diff:/var/lib/docker/overlay2/8160677224d3d0ba75ceac5e22adbe4420f58aa9df575a4fa1eb16cfa5d36cb1/diff:/var/lib/docker/overlay2/747c3fc9ab1ea2616d662bd3b2e2f1ddbdac907a6eea86ac017e9ce3e66dc4d9/diff:/var/lib/docker/overlay2/f8eb124418298912c3691320300767eabaeae37f352f56c2d0e5a40dd97b0bc2/diff:/var/lib/docker/overlay2/c37f4c78c3026a8785fb4aca9fa78dc5ac21307cb3bfbf746bacec078e037770/diff:/var/lib/docker/overlay2/ee71c4960738cdf41b558b5aa16215f18299ecf0b241560a77477f080674ba8c/diff:/var/lib/d
ocker/overlay2/f2132a0cc49a4383ce675ba6870120bd2c58077afad82ab90d066c0651128e1d/diff:/var/lib/docker/overlay2/44200c5ed83b044737127b23b0b15c55e21152acc08ba98910e0dcb93835c4d5/diff:/var/lib/docker/overlay2/22bce5e99989e32cb7a1f876e412e03427623b5cb70e4709d0336c2cae5f4b37/diff:/var/lib/docker/overlay2/ccfb925585c3768c7aba8e731873849181bedce4d441b3095c1abfd310c405e1/diff:/var/lib/docker/overlay2/a90553cf4067ab91ee5ed23daf5f3aab785ded168917688d3c11e7eb856cc869/diff:/var/lib/docker/overlay2/dc493bca572baf2fff7143d6c551dc24acb22082e51a68200466da7510d37550/diff:/var/lib/docker/overlay2/e4fdd0a7dd5c09a7507c2e66bb44972d2db20fd3c58d2191eaa45291e1a47321/diff:/var/lib/docker/overlay2/4badf8f702a906675401fab2bb8327dafc5e0098b8a40e8ae31d3f4337c5539e/diff:/var/lib/docker/overlay2/d7a568f51d57ee1283764757ae3c91db612a7acb01906d88f7321359f27d4dcb/diff:/var/lib/docker/overlay2/123e8c40e6520b691981a6af80c211632618f36cb297ef8a28376985e8b9eddf/diff:/var/lib/docker/overlay2/fcfefbd58c332906200403538c8d881d31cbd97ecd5a2e223b198713731
51469/diff:/var/lib/docker/overlay2/a9e5b72b4ba31d329ac284cad558db42f24197775aaabfd188f2846a0a4ce96d/diff:/var/lib/docker/overlay2/7916e1ed717fc8628e14637400ba911d6e64209e501841613f69224c999b54f8/diff:/var/lib/docker/overlay2/3c121fd6f387f06c1b3a211eb1d7db64ffd333a873146a734de241e936ab5322/diff:/var/lib/docker/overlay2/9958539b4278fcc1c310de22689891aba5f238a94351d3c645b9dacba922241b/diff:/var/lib/docker/overlay2/c6c60f0d02b1e1aad2ea4fa1fb017d98e1ca4602689452dbd721342c0927fc6a/diff:/var/lib/docker/overlay2/e61aabb9eb2161801d4795e4a00f41afd54c504a52aeeef70d49d2a4f47fcd99/diff:/var/lib/docker/overlay2/a69e80d9160e6158cf9f37881d60928bf3221341b1fffe8d2855488233278102/diff:/var/lib/docker/overlay2/f76fd1ba3588d22f5228ab597df7a62e20a79217c1712dbc33e20061e12891c6/diff",
	                "MergedDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/merged",
	                "UpperDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/diff",
	                "WorkDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "pause-20210915191717-498219",
	                "Source": "/var/lib/docker/volumes/pause-20210915191717-498219/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "pause-20210915191717-498219",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "pause-20210915191717-498219",
	                "name.minikube.sigs.k8s.io": "pause-20210915191717-498219",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "27118836b403ba46eaa0c5f84b51105679f32ab8d48b0cf3d1809c92f7eab313",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33158"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33156"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33153"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33155"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33154"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/27118836b403",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "pause-20210915191717-498219": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.76.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "475715a3ea2c"
	                    ],
	                    "NetworkID": "b9847da4d513dbef2974381ee64c2c1cc6dd8d925ac1a45cdcc366eac6d6da5c",
	                    "EndpointID": "fdae2a292c54522fc39bfc656e4fce6fd18fc8d9526f059c210503a13a336d70",
	                    "Gateway": "192.168.76.1",
	                    "IPAddress": "192.168.76.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:4c:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210915191717-498219 -n pause-20210915191717-498219
helpers_test.go:240: (dbg) Done: out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210915191717-498219 -n pause-20210915191717-498219: (1.843564807s)
helpers_test.go:245: <<< TestPause/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:246: ======>  post-mortem[TestPause/serial/Pause]: minikube logs <======
helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20210915191717-498219 logs -n 25
helpers_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p pause-20210915191717-498219 logs -n 25: (1.185597075s)
helpers_test.go:253: TestPause/serial/Pause logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	| Command |                    Args                    |                  Profile                   |  User   | Version |          Start Time           |           End Time            |
	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	| ssh     | -p                                         | test-preload-20210915191317-498219         | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:14:43 UTC | Wed, 15 Sep 2021 19:14:46 UTC |
	|         | test-preload-20210915191317-498219         |                                            |         |         |                               |                               |
	|         | -- sudo crictl pull busybox                |                                            |         |         |                               |                               |
	| start   | -p                                         | test-preload-20210915191317-498219         | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:14:46 UTC | Wed, 15 Sep 2021 19:15:29 UTC |
	|         | test-preload-20210915191317-498219         |                                            |         |         |                               |                               |
	|         | --memory=2200 --alsologtostderr            |                                            |         |         |                               |                               |
	|         | -v=1 --wait=true --driver=docker           |                                            |         |         |                               |                               |
	|         |  --container-runtime=containerd            |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.17.3               |                                            |         |         |                               |                               |
	| ssh     | -p                                         | test-preload-20210915191317-498219         | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:15:29 UTC | Wed, 15 Sep 2021 19:15:29 UTC |
	|         | test-preload-20210915191317-498219         |                                            |         |         |                               |                               |
	|         | -- sudo crictl image ls                    |                                            |         |         |                               |                               |
	| delete  | -p                                         | test-preload-20210915191317-498219         | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:15:29 UTC | Wed, 15 Sep 2021 19:15:32 UTC |
	|         | test-preload-20210915191317-498219         |                                            |         |         |                               |                               |
	| start   | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:15:32 UTC | Wed, 15 Sep 2021 19:16:17 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	|         | --memory=2048 --driver=docker              |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| stop    | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:18 UTC | Wed, 15 Sep 2021 19:16:18 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	|         | --cancel-scheduled                         |                                            |         |         |                               |                               |
	| stop    | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:31 UTC | Wed, 15 Sep 2021 19:16:56 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	|         | --schedule 5s                              |                                            |         |         |                               |                               |
	| delete  | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:58 UTC | Wed, 15 Sep 2021 19:17:03 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	| delete  | -p                                         | insufficient-storage-20210915191703-498219 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:11 UTC | Wed, 15 Sep 2021 19:17:17 UTC |
	|         | insufficient-storage-20210915191703-498219 |                                            |         |         |                               |                               |
	| delete  | -p                                         | kubenet-20210915191717-498219              | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:17:17 UTC |
	|         | kubenet-20210915191717-498219              |                                            |         |         |                               |                               |
	| delete  | -p                                         | flannel-20210915191717-498219              | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:17:18 UTC |
	|         | flannel-20210915191717-498219              |                                            |         |         |                               |                               |
	| delete  | -p false-20210915191718-498219             | false-20210915191718-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:18 UTC | Wed, 15 Sep 2021 19:17:19 UTC |
	| start   | -p                                         | missing-upgrade-20210915191719-498219      | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:18:43 UTC | Wed, 15 Sep 2021 19:19:26 UTC |
	|         | missing-upgrade-20210915191719-498219      |                                            |         |         |                               |                               |
	|         | --memory=2200 --alsologtostderr            |                                            |         |         |                               |                               |
	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | missing-upgrade-20210915191719-498219      | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:19:26 UTC | Wed, 15 Sep 2021 19:19:29 UTC |
	|         | missing-upgrade-20210915191719-498219      |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:19:29 UTC | Wed, 15 Sep 2021 19:20:14 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.14.0               |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| stop    | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:20:14 UTC | Wed, 15 Sep 2021 19:20:35 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	| start   | -p                                         | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:21:46 UTC |
	|         | force-systemd-env-20210915191717-498219    |                                            |         |         |                               |                               |
	|         | --memory=2048 --alsologtostderr            |                                            |         |         |                               |                               |
	|         | -v=5 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| -p      | force-systemd-env-20210915191717-498219    | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:46 UTC | Wed, 15 Sep 2021 19:21:46 UTC |
	|         | ssh cat /etc/containerd/config.toml        |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:20:35 UTC | Wed, 15 Sep 2021 19:21:48 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.22.2-rc.0          |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:46 UTC | Wed, 15 Sep 2021 19:21:50 UTC |
	|         | force-systemd-env-20210915191717-498219    |                                            |         |         |                               |                               |
	| start   | -p                                         | offline-containerd-20210915191717-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:21:56 UTC |
	|         | offline-containerd-20210915191717-498219   |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --memory=2048       |                                            |         |         |                               |                               |
	|         | --wait=true --driver=docker                |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | offline-containerd-20210915191717-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:56 UTC | Wed, 15 Sep 2021 19:22:01 UTC |
	|         | offline-containerd-20210915191717-498219   |                                            |         |         |                               |                               |
	| start   | -p pause-20210915191717-498219             | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:22:36 UTC |
	|         | --memory=2048                              |                                            |         |         |                               |                               |
	|         | --install-addons=false                     |                                            |         |         |                               |                               |
	|         | --wait=all --driver=docker                 |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| start   | -p pause-20210915191717-498219             | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:22:37 UTC | Wed, 15 Sep 2021 19:22:53 UTC |
	|         | --alsologtostderr                          |                                            |         |         |                               |                               |
	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:48 UTC | Wed, 15 Sep 2021 19:22:53 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.22.2-rc.0          |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2021/09/15 19:22:37
	Running on machine: debian-jenkins-agent-1
	Binary: Built with gc go1.17 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0915 19:22:37.006902  655247 out.go:298] Setting OutFile to fd 1 ...
	I0915 19:22:37.006970  655247 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:22:37.006973  655247 out.go:311] Setting ErrFile to fd 2...
	I0915 19:22:37.006977  655247 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:22:37.007073  655247 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	I0915 19:22:37.007294  655247 out.go:305] Setting JSON to false
	I0915 19:22:37.056913  655247 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-1","uptime":18315,"bootTime":1631715442,"procs":312,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}
	I0915 19:22:37.057082  655247 start.go:121] virtualization: kvm guest
	I0915 19:22:37.060596  655247 out.go:177] * [pause-20210915191717-498219] minikube v1.23.0 on Debian 9.13 (kvm/amd64)
	I0915 19:22:37.060752  655247 notify.go:169] Checking for updates...
	I0915 19:22:37.130133  655247 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	I0915 19:22:37.132461  655247 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0915 19:22:37.134149  655247 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube
	I0915 19:22:37.135908  655247 out.go:177]   - MINIKUBE_LOCATION=12425
	I0915 19:22:37.136525  655247 config.go:177] Loaded profile config "pause-20210915191717-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 19:22:37.137119  655247 driver.go:343] Setting default libvirt URI to qemu:///system
	I0915 19:22:37.196827  655247 docker.go:132] docker version: linux-19.03.15
	I0915 19:22:37.196940  655247 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 19:22:37.293924  655247 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:57 OomKillDisable:true NGoroutines:60 SystemTime:2021-09-15 19:22:37.239252947 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 19:22:37.294041  655247 docker.go:237] overlay module found
	I0915 19:22:37.296197  655247 out.go:177] * Using the docker driver based on existing profile
	I0915 19:22:37.296229  655247 start.go:278] selected driver: docker
	I0915 19:22:37.296236  655247 start.go:751] validating driver "docker" against &{Name:pause-20210915191717-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:pause-20210915191717-498219 Namespace:default APIServerName:mi
nikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 19:22:37.296319  655247 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
	I0915 19:22:37.296757  655247 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 19:22:37.392103  655247 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:57 OomKillDisable:true NGoroutines:60 SystemTime:2021-09-15 19:22:37.342057923 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 19:22:37.392667  655247 cni.go:93] Creating CNI manager for ""
	I0915 19:22:37.392691  655247 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet
	I0915 19:22:37.392712  655247 start_flags.go:278] config:
	{Name:pause-20210915191717-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:pause-20210915191717-498219 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunt
ime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 19:22:37.395435  655247 out.go:177] * Starting control plane node pause-20210915191717-498219 in cluster pause-20210915191717-498219
	I0915 19:22:37.395470  655247 cache.go:118] Beginning downloading kic base image for docker with containerd
	I0915 19:22:37.396867  655247 out.go:177] * Pulling base image ...
	I0915 19:22:37.396895  655247 preload.go:131] Checking if preload exists for k8s version v1.22.1 and runtime containerd
	I0915 19:22:37.396929  655247 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4
	I0915 19:22:37.396944  655247 cache.go:57] Caching tarball of preloaded images
	I0915 19:22:37.396997  655247 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon
	I0915 19:22:37.397104  655247 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0915 19:22:37.397124  655247 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.1 on containerd
	I0915 19:22:37.397241  655247 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191717-498219/config.json ...
	I0915 19:22:37.526523  655247 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull
	I0915 19:22:37.526553  655247 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load
	I0915 19:22:37.526571  655247 cache.go:206] Successfully downloaded all kic artifacts
	I0915 19:22:37.526608  655247 start.go:313] acquiring machines lock for pause-20210915191717-498219: {Name:mk868e34b46d94f21a701bddce380979822eb8f9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:22:37.526712  655247 start.go:317] acquired machines lock for "pause-20210915191717-498219" in 76.005µs
	I0915 19:22:37.526737  655247 start.go:93] Skipping create...Using existing machine configuration
	I0915 19:22:37.526746  655247 fix.go:55] fixHost starting: 
	I0915 19:22:37.527064  655247 cli_runner.go:115] Run: docker container inspect pause-20210915191717-498219 --format={{.State.Status}}
	I0915 19:22:37.579116  655247 fix.go:108] recreateIfNeeded on pause-20210915191717-498219: state=Running err=<nil>
	W0915 19:22:37.579147  655247 fix.go:134] unexpected machine state, will restart: <nil>
	I0915 19:22:36.377448  649792 ssh_runner.go:192] Completed: sudo /usr/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5: (13.673754267s)
	I0915 19:22:36.377487  649792 cache_images.go:280] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5
	I0915 19:22:36.377457  649792 ssh_runner.go:192] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/metrics-scraper:v1.0.4": (13.661157372s)
	I0915 19:22:36.377559  649792 ssh_runner.go:192] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-scheduler:v1.22.2-rc.0": (3.693777587s)
	I0915 19:22:36.377561  649792 ssh_runner.go:152] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5
	I0915 19:22:36.377540  649792 ssh_runner.go:192] Completed: which crictl: (3.693662998s)
	I0915 19:22:36.377645  649792 ssh_runner.go:152] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-scheduler:v1.22.2-rc.0
	I0915 19:22:36.377662  649792 ssh_runner.go:192] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-controller-manager:v1.22.2-rc.0": (3.693870587s)
	I0915 19:22:36.377593  649792 ssh_runner.go:192] Completed: which crictl: (3.693739025s)
	I0915 19:22:36.377708  649792 ssh_runner.go:192] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-apiserver:v1.22.2-rc.0": (3.693802568s)
	I0915 19:22:36.377737  649792 ssh_runner.go:152] Run: sudo /usr/bin/crictl rmi docker.io/kubernetesui/dashboard:v2.1.0
	I0915 19:22:36.377745  649792 ssh_runner.go:192] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/coredns/coredns:v1.8.4": (3.69391018s)
	I0915 19:22:36.377811  649792 ssh_runner.go:192] Completed: which crictl: (3.693932764s)
	I0915 19:22:36.377846  649792 ssh_runner.go:152] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/etcd:3.5.0-0
	I0915 19:22:36.377917  649792 ssh_runner.go:192] Completed: which crictl: (3.694026661s)
	I0915 19:22:36.377956  649792 ssh_runner.go:152] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-apiserver:v1.22.2-rc.0
	I0915 19:22:36.712313  649792 ssh_runner.go:192] Completed: which crictl: (4.028383312s)
	I0915 19:22:36.712346  649792 ssh_runner.go:192] Completed: which crictl: (4.028416759s)
	I0915 19:22:36.712374  649792 ssh_runner.go:152] Run: sudo /usr/bin/crictl rmi docker.io/kubernetesui/metrics-scraper:v1.0.4
	I0915 19:22:36.712387  649792 ssh_runner.go:152] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-controller-manager:v1.22.2-rc.0
	I0915 19:22:36.712449  649792 ssh_runner.go:192] Completed: which crictl: (4.028534978s)
	I0915 19:22:36.712496  649792 ssh_runner.go:152] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/coredns/coredns:v1.8.4
	I0915 19:22:36.712526  649792 ssh_runner.go:192] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/etcd:3.5.0-0": (4.028615553s)
	I0915 19:22:36.712580  649792 cache_images.go:280] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.22.2-rc.0
	I0915 19:22:36.712621  649792 ssh_runner.go:192] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/dashboard:v2.1.0": (4.028726107s)
	I0915 19:22:36.712699  649792 ssh_runner.go:313] copy: skipping /var/lib/minikube/images/storage-provisioner_v5 (exists)
	I0915 19:22:36.712710  649792 cache_images.go:280] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0
	I0915 19:22:36.712717  649792 containerd.go:305] Loading image: /var/lib/minikube/images/storage-provisioner_v5
	I0915 19:22:36.712780  649792 ssh_runner.go:152] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/storage-provisioner_v5
	I0915 19:22:36.712791  649792 cache_images.go:280] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/etcd_3.5.0-0
	I0915 19:22:36.712814  649792 cache_images.go:280] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.22.2-rc.0
	I0915 19:22:36.712781  649792 ssh_runner.go:152] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.1.0
	I0915 19:22:36.712852  649792 ssh_runner.go:152] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.0-0
	I0915 19:22:37.148732  649792 cache_images.go:280] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4
	I0915 19:22:37.148834  649792 ssh_runner.go:152] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.4
	I0915 19:22:37.148920  649792 cache_images.go:280] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.22.2-rc.0
	I0915 19:22:37.148961  649792 cache_images.go:280] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns/coredns_v1.8.4
	I0915 19:22:37.149013  649792 ssh_runner.go:152] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.8.4
	I0915 19:22:38.439632  649792 ssh_runner.go:192] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.1.0: (1.726774876s)
	I0915 19:22:38.439657  649792 ssh_runner.go:192] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/storage-provisioner_v5: (1.726844466s)
	I0915 19:22:38.439669  649792 ssh_runner.go:313] copy: skipping /var/lib/minikube/images/dashboard_v2.1.0 (exists)
	I0915 19:22:38.439682  649792 cache_images.go:309] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
	I0915 19:22:38.439711  649792 containerd.go:305] Loading image: /var/lib/minikube/images/dashboard_v2.1.0
	I0915 19:22:38.439716  649792 ssh_runner.go:192] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.0-0: (1.726850177s)
	I0915 19:22:38.439739  649792 ssh_runner.go:313] copy: skipping /var/lib/minikube/images/etcd_3.5.0-0 (exists)
	I0915 19:22:38.439756  649792 ssh_runner.go:152] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/dashboard_v2.1.0
	I0915 19:22:38.439784  649792 ssh_runner.go:192] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.8.4: (1.290758347s)
	I0915 19:22:38.439796  649792 ssh_runner.go:313] copy: skipping /var/lib/minikube/images/coredns_v1.8.4 (exists)
	I0915 19:22:38.439756  649792 ssh_runner.go:192] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.4: (1.290907319s)
	I0915 19:22:38.439813  649792 ssh_runner.go:313] copy: skipping /var/lib/minikube/images/metrics-scraper_v1.0.4 (exists)
	I0915 19:22:37.581028  655247 out.go:177] * Updating the running docker "pause-20210915191717-498219" container ...
	I0915 19:22:37.581060  655247 machine.go:88] provisioning docker machine ...
	I0915 19:22:37.581087  655247 ubuntu.go:169] provisioning hostname "pause-20210915191717-498219"
	I0915 19:22:37.581142  655247 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20210915191717-498219
	I0915 19:22:37.621578  655247 main.go:130] libmachine: Using SSH client type: native
	I0915 19:22:37.621903  655247 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33158 <nil> <nil>}
	I0915 19:22:37.621922  655247 main.go:130] libmachine: About to run SSH command:
	sudo hostname pause-20210915191717-498219 && echo "pause-20210915191717-498219" | sudo tee /etc/hostname
	I0915 19:22:37.747918  655247 main.go:130] libmachine: SSH cmd err, output: <nil>: pause-20210915191717-498219
	
	I0915 19:22:37.748002  655247 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20210915191717-498219
	I0915 19:22:37.792055  655247 main.go:130] libmachine: Using SSH client type: native
	I0915 19:22:37.792250  655247 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33158 <nil> <nil>}
	I0915 19:22:37.792271  655247 main.go:130] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\spause-20210915191717-498219' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 pause-20210915191717-498219/g' /etc/hosts;
				else 
					echo '127.0.1.1 pause-20210915191717-498219' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0915 19:22:37.903153  655247 main.go:130] libmachine: SSH cmd err, output: <nil>: 
	I0915 19:22:37.903190  655247 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157
/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube}
	I0915 19:22:37.903220  655247 ubuntu.go:177] setting up certificates
	I0915 19:22:37.903239  655247 provision.go:83] configureAuth start
	I0915 19:22:37.903301  655247 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" pause-20210915191717-498219
	I0915 19:22:37.953622  655247 provision.go:138] copyHostCerts
	I0915 19:22:37.953692  655247 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem, removing ...
	I0915 19:22:37.953707  655247 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem
	I0915 19:22:37.953773  655247 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem (1082 bytes)
	I0915 19:22:37.953863  655247 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem, removing ...
	I0915 19:22:37.953877  655247 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem
	I0915 19:22:37.953904  655247 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem (1123 bytes)
	I0915 19:22:37.953960  655247 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem, removing ...
	I0915 19:22:37.953970  655247 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem
	I0915 19:22:37.953994  655247 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem (1679 bytes)
	I0915 19:22:37.954054  655247 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem org=jenkins.pause-20210915191717-498219 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube pause-20210915191717-498219]
	I0915 19:22:38.109863  655247 provision.go:172] copyRemoteCerts
	I0915 19:22:38.109934  655247 ssh_runner.go:152] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0915 19:22:38.109976  655247 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20210915191717-498219
	I0915 19:22:38.160603  655247 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33158 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/pause-20210915191717-498219/id_rsa Username:docker}
	I0915 19:22:38.244419  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0915 19:22:38.265821  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem --> /etc/docker/server.pem (1253 bytes)
	I0915 19:22:38.283232  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0915 19:22:38.299821  655247 provision.go:86] duration metric: configureAuth took 396.564881ms
	I0915 19:22:38.299852  655247 ubuntu.go:193] setting minikube options for container-runtime
	I0915 19:22:38.300010  655247 config.go:177] Loaded profile config "pause-20210915191717-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 19:22:38.300026  655247 machine.go:91] provisioned docker machine in 718.960984ms
	I0915 19:22:38.300034  655247 start.go:267] post-start starting for "pause-20210915191717-498219" (driver="docker")
	I0915 19:22:38.300041  655247 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0915 19:22:38.300081  655247 ssh_runner.go:152] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0915 19:22:38.300116  655247 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20210915191717-498219
	I0915 19:22:38.346650  655247 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33158 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/pause-20210915191717-498219/id_rsa Username:docker}
	I0915 19:22:38.432008  655247 ssh_runner.go:152] Run: cat /etc/os-release
	I0915 19:22:38.435010  655247 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0915 19:22:38.435033  655247 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0915 19:22:38.435042  655247 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0915 19:22:38.435047  655247 info.go:137] Remote host: Ubuntu 20.04.2 LTS
	I0915 19:22:38.435056  655247 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/addons for local assets ...
	I0915 19:22:38.435102  655247 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files for local assets ...
	I0915 19:22:38.435168  655247 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/4982192.pem -> 4982192.pem in /etc/ssl/certs
	I0915 19:22:38.435253  655247 ssh_runner.go:152] Run: sudo mkdir -p /etc/ssl/certs
	I0915 19:22:38.442207  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/4982192.pem --> /etc/ssl/certs/4982192.pem (1708 bytes)
	I0915 19:22:38.458830  655247 start.go:270] post-start completed in 158.78139ms
	I0915 19:22:38.458899  655247 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0915 19:22:38.458948  655247 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20210915191717-498219
	I0915 19:22:38.506586  655247 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33158 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/pause-20210915191717-498219/id_rsa Username:docker}
	I0915 19:22:38.584338  655247 fix.go:57] fixHost completed within 1.05758385s
	I0915 19:22:38.584370  655247 start.go:80] releasing machines lock for "pause-20210915191717-498219", held for 1.057643626s
	I0915 19:22:38.584462  655247 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" pause-20210915191717-498219
	I0915 19:22:38.626385  655247 ssh_runner.go:152] Run: systemctl --version
	I0915 19:22:38.626442  655247 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20210915191717-498219
	I0915 19:22:38.626480  655247 ssh_runner.go:152] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0915 19:22:38.626533  655247 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20210915191717-498219
	I0915 19:22:38.680935  655247 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33158 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/pause-20210915191717-498219/id_rsa Username:docker}
	I0915 19:22:38.683449  655247 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33158 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/pause-20210915191717-498219/id_rsa Username:docker}
	I0915 19:22:38.760160  655247 ssh_runner.go:152] Run: sudo systemctl stop -f crio
	I0915 19:22:38.785734  655247 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service crio
	I0915 19:22:38.795238  655247 docker.go:156] disabling docker service ...
	I0915 19:22:38.795287  655247 ssh_runner.go:152] Run: sudo systemctl stop -f docker.socket
	I0915 19:22:38.811049  655247 ssh_runner.go:152] Run: sudo systemctl stop -f docker.service
	I0915 19:22:38.819641  655247 ssh_runner.go:152] Run: sudo systemctl disable docker.socket
	I0915 19:22:38.926744  655247 ssh_runner.go:152] Run: sudo systemctl mask docker.service
	I0915 19:22:39.029356  655247 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service docker
	I0915 19:22:39.039719  655247 ssh_runner.go:152] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	image-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0915 19:22:39.054703  655247 ssh_runner.go:152] Run: /bin/bash -c "sudo mkdir -p /etc/containerd && printf %!s(MISSING) "cm9vdCA9ICIvdmFyL2xpYi9jb250YWluZXJkIgpzdGF0ZSA9ICIvcnVuL2NvbnRhaW5lcmQiCm9vbV9zY29yZSA9IDAKW2dycGNdCiAgYWRkcmVzcyA9ICIvcnVuL2NvbnRhaW5lcmQvY29udGFpbmVyZC5zb2NrIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbWF4X3JlY3ZfbWVzc2FnZV9zaXplID0gMTY3NzcyMTYKICBtYXhfc2VuZF9tZXNzYWdlX3NpemUgPSAxNjc3NzIxNgoKW2RlYnVnXQogIGFkZHJlc3MgPSAiIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbGV2ZWwgPSAiIgoKW21ldHJpY3NdCiAgYWRkcmVzcyA9ICIiCiAgZ3JwY19oaXN0b2dyYW0gPSBmYWxzZQoKW2Nncm91cF0KICBwYXRoID0gIiIKCltwcm94eV9wbHVnaW5zXQojIGZ1c2Utb3ZlcmxheWZzIGlzIHVzZWQgZm9yIHJvb3RsZXNzCltwcm94eV9wbHVnaW5zLiJmdXNlLW92ZXJsYXlmcyJdCiAgdHlwZSA9ICJzbmFwc2hvdCIKICBhZGRyZXNzID0gIi9ydW4vY29udGFpbmVyZC1mdXNlLW92ZXJsYXlmcy5zb2NrIgoKW3BsdWdpbnNdCiAgW3BsdWdpbnMuY2dyb3Vwc10KICAgIG5vX3Byb21ldGhldXMgPSBmYWxzZQogIFtwbHVnaW5zLmNyaV0KICAgIHN0cmVhbV9zZXJ2ZXJfYWRkcmVzcyA9ICIiCiAgICBzdHJlYW1fc2VydmVyX3BvcnQgPSAiMTAwMTAiCiAgICBlbmFibGVfc2VsaW51eCA9IGZhbHNlCiAgICBzY
W5kYm94X2ltYWdlID0gIms4cy5nY3IuaW8vcGF1c2U6My41IgogICAgc3RhdHNfY29sbGVjdF9wZXJpb2QgPSAxMAogICAgZW5hYmxlX3Rsc19zdHJlYW1pbmcgPSBmYWxzZQogICAgbWF4X2NvbnRhaW5lcl9sb2dfbGluZV9zaXplID0gMTYzODQKICAgIHJlc3RyaWN0X29vbV9zY29yZV9hZGogPSBmYWxzZQoKCVtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIl0KICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmRdCiAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXNdCiAgICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5ydW50aW1lcy5ydW5jXQogICAgICAgICAgICBydW50aW1lX3R5cGUgPSAiaW8uY29udGFpbmVyZC5ydW5jLnYyIgogICAgICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5ydW50aW1lcy5ydW5jLm9wdGlvbnNdCiAgICAgICAgICAgICAgU3lzdGVtZENncm91cCA9IGZhbHNlCgogICAgW3BsdWdpbnMuY3JpLmNvbnRhaW5lcmRdCiAgICAgIHNuYXBzaG90dGVyID0gIm92ZXJsYXlmcyIKICAgICAgW3BsdWdpbnMuY3JpLmNvbnRhaW5lcmQuZGVmYXVsdF9ydW50aW1lXQogICAgICAgIHJ1bnRpbWVfdHlwZSA9ICJpby5jb250YWluZXJkLnJ1bmMudjIiCiAgICAgIFtwbHVnaW5zLmNyaS5jb250YWluZXJkLnVud
HJ1c3RlZF93b3JrbG9hZF9ydW50aW1lXQogICAgICAgIHJ1bnRpbWVfdHlwZSA9ICIiCiAgICAgICAgcnVudGltZV9lbmdpbmUgPSAiIgogICAgICAgIHJ1bnRpbWVfcm9vdCA9ICIiCiAgICBbcGx1Z2lucy5jcmkuY25pXQogICAgICBiaW5fZGlyID0gIi9vcHQvY25pL2JpbiIKICAgICAgY29uZl9kaXIgPSAiL2V0Yy9jbmkvbmV0Lm1rIgogICAgICBjb25mX3RlbXBsYXRlID0gIiIKICAgIFtwbHVnaW5zLmNyaS5yZWdpc3RyeV0KICAgICAgW3BsdWdpbnMuY3JpLnJlZ2lzdHJ5Lm1pcnJvcnNdCiAgICAgICAgW3BsdWdpbnMuY3JpLnJlZ2lzdHJ5Lm1pcnJvcnMuImRvY2tlci5pbyJdCiAgICAgICAgICBlbmRwb2ludCA9IFsiaHR0cHM6Ly9yZWdpc3RyeS0xLmRvY2tlci5pbyJdCiAgICAgICAgW3BsdWdpbnMuZGlmZi1zZXJ2aWNlXQogICAgZGVmYXVsdCA9IFsid2Fsa2luZyJdCiAgW3BsdWdpbnMuc2NoZWR1bGVyXQogICAgcGF1c2VfdGhyZXNob2xkID0gMC4wMgogICAgZGVsZXRpb25fdGhyZXNob2xkID0gMAogICAgbXV0YXRpb25fdGhyZXNob2xkID0gMTAwCiAgICBzY2hlZHVsZV9kZWxheSA9ICIwcyIKICAgIHN0YXJ0dXBfZGVsYXkgPSAiMTAwbXMiCg==" | base64 -d | sudo tee /etc/containerd/config.toml"
	I0915 19:22:39.070437  655247 ssh_runner.go:152] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0915 19:22:39.077843  655247 crio.go:128] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
	stdout:
	
	stderr:
	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
	I0915 19:22:39.077947  655247 ssh_runner.go:152] Run: sudo modprobe br_netfilter
	I0915 19:22:39.086963  655247 ssh_runner.go:152] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0915 19:22:39.094649  655247 ssh_runner.go:152] Run: sudo systemctl daemon-reload
	I0915 19:22:39.191717  655247 ssh_runner.go:152] Run: sudo systemctl restart containerd
	I0915 19:22:39.292715  655247 start.go:393] Will wait 60s for socket path /run/containerd/containerd.sock
	I0915 19:22:39.292794  655247 ssh_runner.go:152] Run: stat /run/containerd/containerd.sock
	I0915 19:22:39.296770  655247 start.go:414] Will wait 60s for crictl version
	I0915 19:22:39.296838  655247 ssh_runner.go:152] Run: sudo crictl version
	I0915 19:22:39.323314  655247 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2021-09-15T19:22:39Z" level=fatal msg="getting the runtime version: rpc error: code = Unknown desc = server is not initialized yet"
	I0915 19:22:43.655951  649792 ssh_runner.go:192] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/dashboard_v2.1.0: (5.2161654s)
	I0915 19:22:43.655985  649792 cache_images.go:309] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0 from cache
	I0915 19:22:43.656024  649792 containerd.go:305] Loading image: /var/lib/minikube/images/etcd_3.5.0-0
	I0915 19:22:43.656088  649792 ssh_runner.go:152] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/etcd_3.5.0-0
	I0915 19:22:50.372857  655247 ssh_runner.go:152] Run: sudo crictl version
	I0915 19:22:50.401084  655247 start.go:423] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.4.9
	RuntimeApiVersion:  v1alpha2
	I0915 19:22:50.401148  655247 ssh_runner.go:152] Run: containerd --version
	I0915 19:22:50.424817  655247 ssh_runner.go:152] Run: containerd --version
	I0915 19:22:50.452648  655247 out.go:177] * Preparing Kubernetes v1.22.1 on containerd 1.4.9 ...
	I0915 19:22:50.452738  655247 cli_runner.go:115] Run: docker network inspect pause-20210915191717-498219 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0915 19:22:50.506029  655247 ssh_runner.go:152] Run: grep 192.168.76.1	host.minikube.internal$ /etc/hosts
	I0915 19:22:50.509771  655247 preload.go:131] Checking if preload exists for k8s version v1.22.1 and runtime containerd
	I0915 19:22:50.509831  655247 ssh_runner.go:152] Run: sudo crictl images --output json
	I0915 19:22:50.534560  655247 containerd.go:657] all images are preloaded for containerd runtime.
	I0915 19:22:50.534584  655247 containerd.go:561] Images already preloaded, skipping extraction
	I0915 19:22:50.534635  655247 ssh_runner.go:152] Run: sudo crictl images --output json
	I0915 19:22:50.560554  655247 containerd.go:657] all images are preloaded for containerd runtime.
	I0915 19:22:50.560582  655247 cache_images.go:78] Images are preloaded, skipping loading
	I0915 19:22:50.560640  655247 ssh_runner.go:152] Run: sudo crictl info
	I0915 19:22:50.589560  655247 cni.go:93] Creating CNI manager for ""
	I0915 19:22:50.589588  655247 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet
	I0915 19:22:50.589604  655247 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0915 19:22:50.589621  655247 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.22.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:pause-20210915191717-498219 NodeName:pause-20210915191717-498219 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/v
ar/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0915 19:22:50.589802  655247 kubeadm.go:157] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.76.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "pause-20210915191717-498219"
	  kubeletExtraArgs:
	    node-ip: 192.168.76.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.22.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0915 19:22:50.589927  655247 kubeadm.go:909] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.22.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cni-conf-dir=/etc/cni/net.mk --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=pause-20210915191717-498219 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.22.1 ClusterName:pause-20210915191717-498219 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0915 19:22:50.589994  655247 ssh_runner.go:152] Run: sudo ls /var/lib/minikube/binaries/v1.22.1
	I0915 19:22:50.598685  655247 binaries.go:44] Found k8s binaries, skipping transfer
	I0915 19:22:50.598757  655247 ssh_runner.go:152] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0915 19:22:50.607171  655247 ssh_runner.go:319] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (572 bytes)
	I0915 19:22:50.623271  655247 ssh_runner.go:319] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0915 19:22:50.637905  655247 ssh_runner.go:319] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2077 bytes)
	I0915 19:22:50.656330  655247 ssh_runner.go:152] Run: grep 192.168.76.2	control-plane.minikube.internal$ /etc/hosts
	I0915 19:22:50.660217  655247 certs.go:52] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191717-498219 for IP: 192.168.76.2
	I0915 19:22:50.660276  655247 certs.go:179] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.key
	I0915 19:22:50.660298  655247 certs.go:179] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/proxy-client-ca.key
	I0915 19:22:50.660363  655247 certs.go:293] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191717-498219/client.key
	I0915 19:22:50.660387  655247 certs.go:293] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191717-498219/apiserver.key.31bdca25
	I0915 19:22:50.660410  655247 certs.go:293] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191717-498219/proxy-client.key
	I0915 19:22:50.660544  655247 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/498219.pem (1338 bytes)
	W0915 19:22:50.660592  655247 certs.go:372] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/498219_empty.pem, impossibly tiny 0 bytes
	I0915 19:22:50.660605  655247 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem (1679 bytes)
	I0915 19:22:50.660635  655247 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem (1082 bytes)
	I0915 19:22:50.660678  655247 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem (1123 bytes)
	I0915 19:22:50.660718  655247 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/key.pem (1679 bytes)
	I0915 19:22:50.660780  655247 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/4982192.pem (1708 bytes)
	I0915 19:22:50.662130  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191717-498219/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0915 19:22:50.682429  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191717-498219/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0915 19:22:50.702673  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191717-498219/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0915 19:22:50.742141  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191717-498219/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0915 19:22:50.776164  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0915 19:22:50.795184  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0915 19:22:50.813880  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0915 19:22:50.834801  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0915 19:22:50.852450  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/498219.pem --> /usr/share/ca-certificates/498219.pem (1338 bytes)
	I0915 19:22:50.885140  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/4982192.pem --> /usr/share/ca-certificates/4982192.pem (1708 bytes)
	I0915 19:22:50.906800  655247 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0915 19:22:50.923515  655247 ssh_runner.go:319] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0915 19:22:50.937600  655247 ssh_runner.go:152] Run: openssl version
	I0915 19:22:50.943806  655247 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4982192.pem && ln -fs /usr/share/ca-certificates/4982192.pem /etc/ssl/certs/4982192.pem"
	I0915 19:22:50.953795  655247 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/4982192.pem
	I0915 19:22:50.957839  655247 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Sep 15 18:47 /usr/share/ca-certificates/4982192.pem
	I0915 19:22:50.957897  655247 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4982192.pem
	I0915 19:22:50.964053  655247 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/4982192.pem /etc/ssl/certs/3ec20f2e.0"
	I0915 19:22:50.973491  655247 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0915 19:22:50.980894  655247 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0915 19:22:50.983784  655247 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Sep 15 18:42 /usr/share/ca-certificates/minikubeCA.pem
	I0915 19:22:50.983821  655247 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0915 19:22:50.988335  655247 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0915 19:22:50.994918  655247 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/498219.pem && ln -fs /usr/share/ca-certificates/498219.pem /etc/ssl/certs/498219.pem"
	I0915 19:22:51.001865  655247 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/498219.pem
	I0915 19:22:51.004763  655247 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Sep 15 18:47 /usr/share/ca-certificates/498219.pem
	I0915 19:22:51.004803  655247 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/498219.pem
	I0915 19:22:51.009411  655247 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/498219.pem /etc/ssl/certs/51391683.0"
	I0915 19:22:51.015974  655247 kubeadm.go:390] StartCluster: {Name:pause-20210915191717-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:pause-20210915191717-498219 Namespace:default APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 19:22:51.016066  655247 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0915 19:22:51.016103  655247 ssh_runner.go:152] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0915 19:22:51.047274  655247 cri.go:76] found id: "4e3e2ce59d5c18a575c0fcd0817a37be6f3100ed723ce065f62dde7f1eb0a51c"
	I0915 19:22:51.047302  655247 cri.go:76] found id: "add40aaf7d1e10f027cdbe1822c9e2e3a692eb9dcc9ce52c62557d8bf4504255"
	I0915 19:22:51.047310  655247 cri.go:76] found id: "0f8eb1bcec3c031e531b43c748eea2d33912cf7d55db49e7ea71778813c0c49d"
	I0915 19:22:51.047357  655247 cri.go:76] found id: "ffa7fe563436a7ae8d7cecd36b9ff38df2bcc5435d8942a21f17d65219db5c80"
	I0915 19:22:51.047364  655247 cri.go:76] found id: "f9a6017a48e430457074558a4f8587452f4bc9da312b0a267d9b4c66ec6698a3"
	I0915 19:22:51.047371  655247 cri.go:76] found id: "c59a5411d0a433dc24d4b92cbfe6897ccefe0c7791ebb38fa78a538f7451455a"
	I0915 19:22:51.047378  655247 cri.go:76] found id: "68c751171dcd7d647b503ddd8a23729be4c80075be04f4911d2d09c0cd2ef1d6"
	I0915 19:22:51.047386  655247 cri.go:76] found id: ""
	I0915 19:22:51.047433  655247 ssh_runner.go:152] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0915 19:22:51.088312  655247 cri.go:103] JSON = [{"ociVersion":"1.0.2-dev","id":"0f8eb1bcec3c031e531b43c748eea2d33912cf7d55db49e7ea71778813c0c49d","pid":2543,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/0f8eb1bcec3c031e531b43c748eea2d33912cf7d55db49e7ea71778813c0c49d","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/0f8eb1bcec3c031e531b43c748eea2d33912cf7d55db49e7ea71778813c0c49d/rootfs","created":"2021-09-15T19:22:00.027725362Z","annotations":{"io.kubernetes.cri.container-name":"kube-proxy","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"615b93865a2452ccedfce1ae2e00632802f0e27d51d5f04eee0b5bd467571df5"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"4e3e2ce59d5c18a575c0fcd0817a37be6f3100ed723ce065f62dde7f1eb0a51c","pid":2818,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/4e3e2ce59d5c18a575c0fcd0817a37be6f3100ed723ce065f62dde7f1eb0a51c","rootfs":"/run/containerd/io.containerd.runtime
.v2.task/k8s.io/4e3e2ce59d5c18a575c0fcd0817a37be6f3100ed723ce065f62dde7f1eb0a51c/rootfs","created":"2021-09-15T19:22:20.575750171Z","annotations":{"io.kubernetes.cri.container-name":"coredns","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"7ea0d242ee6d7ed0a1690059a63fa487e24d1e24883a161a7473555b2630e5c8"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"615b93865a2452ccedfce1ae2e00632802f0e27d51d5f04eee0b5bd467571df5","pid":2446,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/615b93865a2452ccedfce1ae2e00632802f0e27d51d5f04eee0b5bd467571df5","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/615b93865a2452ccedfce1ae2e00632802f0e27d51d5f04eee0b5bd467571df5/rootfs","created":"2021-09-15T19:21:57.927680418Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"615b93865a2452ccedfce1ae2e00632802f0e27d51d5f04eee0b5bd467571df5","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-pr
oxy-x78hq_78449e93-ea1e-46cd-92ca-d416ecbee251"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"68c751171dcd7d647b503ddd8a23729be4c80075be04f4911d2d09c0cd2ef1d6","pid":1535,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/68c751171dcd7d647b503ddd8a23729be4c80075be04f4911d2d09c0cd2ef1d6","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/68c751171dcd7d647b503ddd8a23729be4c80075be04f4911d2d09c0cd2ef1d6/rootfs","created":"2021-09-15T19:21:36.947569157Z","annotations":{"io.kubernetes.cri.container-name":"etcd","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"d9f651544d709d16c6efc0de6ada610461ff2c10ea3d5579b27bc741b194eeb4"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"7ea0d242ee6d7ed0a1690059a63fa487e24d1e24883a161a7473555b2630e5c8","pid":2784,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/7ea0d242ee6d7ed0a1690059a63fa487e24d1e24883a161a7473555b2630e5c8","rootfs":"/run/containerd/io.containerd.runtime
.v2.task/k8s.io/7ea0d242ee6d7ed0a1690059a63fa487e24d1e24883a161a7473555b2630e5c8/rootfs","created":"2021-09-15T19:22:20.267696982Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"7ea0d242ee6d7ed0a1690059a63fa487e24d1e24883a161a7473555b2630e5c8","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_coredns-78fcd69978-87x4l_bacedd06-5f04-410d-bb77-6d7082ac74d8"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"84d365a86ab3134eac7698af7afad8e8113013f13df92d10e83afaf7941bb654","pid":2454,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/84d365a86ab3134eac7698af7afad8e8113013f13df92d10e83afaf7941bb654","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/84d365a86ab3134eac7698af7afad8e8113013f13df92d10e83afaf7941bb654/rootfs","created":"2021-09-15T19:21:58.163638372Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"84d365a86ab3134eac7698af7afad8e8113013f13df92d10e83afaf79
41bb654","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kindnet-m5zrb_b75f582d-6b59-4a29-8f66-5670fc372ef7"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"88a3889c95bb5fe9da79a38aa26c4bb96e5d6ac1977fc93bc11d99eb13536f9f","pid":1445,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/88a3889c95bb5fe9da79a38aa26c4bb96e5d6ac1977fc93bc11d99eb13536f9f","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/88a3889c95bb5fe9da79a38aa26c4bb96e5d6ac1977fc93bc11d99eb13536f9f/rootfs","created":"2021-09-15T19:21:36.736659099Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"88a3889c95bb5fe9da79a38aa26c4bb96e5d6ac1977fc93bc11d99eb13536f9f","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-scheduler-pause-20210915191717-498219_9c256c5728161f178afed3bb76249071"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"9801458e1a86a24fcb9369b438b3075ad57794fa3390f20637c1f20d161e8041","pid":1438,"status":"r
unning","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/9801458e1a86a24fcb9369b438b3075ad57794fa3390f20637c1f20d161e8041","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/9801458e1a86a24fcb9369b438b3075ad57794fa3390f20637c1f20d161e8041/rootfs","created":"2021-09-15T19:21:36.735548381Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"9801458e1a86a24fcb9369b438b3075ad57794fa3390f20637c1f20d161e8041","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-controller-manager-pause-20210915191717-498219_a79d6065b06ae4e3e8ecdbd9f2784be5"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"add40aaf7d1e10f027cdbe1822c9e2e3a692eb9dcc9ce52c62557d8bf4504255","pid":2532,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/add40aaf7d1e10f027cdbe1822c9e2e3a692eb9dcc9ce52c62557d8bf4504255","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/add40aaf7d1e10f027cdbe1822c9e2e3a692eb9dcc9ce52c62557d8bf4
504255/rootfs","created":"2021-09-15T19:22:00.207635864Z","annotations":{"io.kubernetes.cri.container-name":"kindnet-cni","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"84d365a86ab3134eac7698af7afad8e8113013f13df92d10e83afaf7941bb654"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"af1e2cc7dc24b45471cf57358688c86eb6a2d88bd25aea200dbde73258eda494","pid":1417,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/af1e2cc7dc24b45471cf57358688c86eb6a2d88bd25aea200dbde73258eda494","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/af1e2cc7dc24b45471cf57358688c86eb6a2d88bd25aea200dbde73258eda494/rootfs","created":"2021-09-15T19:21:36.671608729Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"af1e2cc7dc24b45471cf57358688c86eb6a2d88bd25aea200dbde73258eda494","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-apiserver-pause-20210915191717-498219_7711ec5bdcd091468467911b3afef6b2"}
,"owner":"root"},{"ociVersion":"1.0.2-dev","id":"c59a5411d0a433dc24d4b92cbfe6897ccefe0c7791ebb38fa78a538f7451455a","pid":1542,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/c59a5411d0a433dc24d4b92cbfe6897ccefe0c7791ebb38fa78a538f7451455a","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/c59a5411d0a433dc24d4b92cbfe6897ccefe0c7791ebb38fa78a538f7451455a/rootfs","created":"2021-09-15T19:21:36.94766568Z","annotations":{"io.kubernetes.cri.container-name":"kube-apiserver","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"af1e2cc7dc24b45471cf57358688c86eb6a2d88bd25aea200dbde73258eda494"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"d9f651544d709d16c6efc0de6ada610461ff2c10ea3d5579b27bc741b194eeb4","pid":1365,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/d9f651544d709d16c6efc0de6ada610461ff2c10ea3d5579b27bc741b194eeb4","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/d9f651544d709d16c6efc0d
e6ada610461ff2c10ea3d5579b27bc741b194eeb4/rootfs","created":"2021-09-15T19:21:36.639636261Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"d9f651544d709d16c6efc0de6ada610461ff2c10ea3d5579b27bc741b194eeb4","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_etcd-pause-20210915191717-498219_75672d7d5943d04aff4397a3563175b2"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"f9a6017a48e430457074558a4f8587452f4bc9da312b0a267d9b4c66ec6698a3","pid":1587,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/f9a6017a48e430457074558a4f8587452f4bc9da312b0a267d9b4c66ec6698a3","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/f9a6017a48e430457074558a4f8587452f4bc9da312b0a267d9b4c66ec6698a3/rootfs","created":"2021-09-15T19:21:37.039680492Z","annotations":{"io.kubernetes.cri.container-name":"kube-scheduler","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"88a3889c95bb5fe9da79a38aa26c4bb96e5d6a
c1977fc93bc11d99eb13536f9f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"ffa7fe563436a7ae8d7cecd36b9ff38df2bcc5435d8942a21f17d65219db5c80","pid":1594,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/ffa7fe563436a7ae8d7cecd36b9ff38df2bcc5435d8942a21f17d65219db5c80","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/ffa7fe563436a7ae8d7cecd36b9ff38df2bcc5435d8942a21f17d65219db5c80/rootfs","created":"2021-09-15T19:21:37.038633928Z","annotations":{"io.kubernetes.cri.container-name":"kube-controller-manager","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"9801458e1a86a24fcb9369b438b3075ad57794fa3390f20637c1f20d161e8041"},"owner":"root"}]
	I0915 19:22:51.088548  655247 cri.go:113] list returned 14 containers
	I0915 19:22:51.088563  655247 cri.go:116] container: {ID:0f8eb1bcec3c031e531b43c748eea2d33912cf7d55db49e7ea71778813c0c49d Status:running}
	I0915 19:22:51.088603  655247 cri.go:122] skipping {0f8eb1bcec3c031e531b43c748eea2d33912cf7d55db49e7ea71778813c0c49d running}: state = "running", want "paused"
	I0915 19:22:51.088618  655247 cri.go:116] container: {ID:4e3e2ce59d5c18a575c0fcd0817a37be6f3100ed723ce065f62dde7f1eb0a51c Status:running}
	I0915 19:22:51.088625  655247 cri.go:122] skipping {4e3e2ce59d5c18a575c0fcd0817a37be6f3100ed723ce065f62dde7f1eb0a51c running}: state = "running", want "paused"
	I0915 19:22:51.088634  655247 cri.go:116] container: {ID:615b93865a2452ccedfce1ae2e00632802f0e27d51d5f04eee0b5bd467571df5 Status:running}
	I0915 19:22:51.088641  655247 cri.go:118] skipping 615b93865a2452ccedfce1ae2e00632802f0e27d51d5f04eee0b5bd467571df5 - not in ps
	I0915 19:22:51.088648  655247 cri.go:116] container: {ID:68c751171dcd7d647b503ddd8a23729be4c80075be04f4911d2d09c0cd2ef1d6 Status:running}
	I0915 19:22:51.088658  655247 cri.go:122] skipping {68c751171dcd7d647b503ddd8a23729be4c80075be04f4911d2d09c0cd2ef1d6 running}: state = "running", want "paused"
	I0915 19:22:51.088664  655247 cri.go:116] container: {ID:7ea0d242ee6d7ed0a1690059a63fa487e24d1e24883a161a7473555b2630e5c8 Status:running}
	I0915 19:22:51.088673  655247 cri.go:118] skipping 7ea0d242ee6d7ed0a1690059a63fa487e24d1e24883a161a7473555b2630e5c8 - not in ps
	I0915 19:22:51.088678  655247 cri.go:116] container: {ID:84d365a86ab3134eac7698af7afad8e8113013f13df92d10e83afaf7941bb654 Status:running}
	I0915 19:22:51.088687  655247 cri.go:118] skipping 84d365a86ab3134eac7698af7afad8e8113013f13df92d10e83afaf7941bb654 - not in ps
	I0915 19:22:51.088692  655247 cri.go:116] container: {ID:88a3889c95bb5fe9da79a38aa26c4bb96e5d6ac1977fc93bc11d99eb13536f9f Status:running}
	I0915 19:22:51.088701  655247 cri.go:118] skipping 88a3889c95bb5fe9da79a38aa26c4bb96e5d6ac1977fc93bc11d99eb13536f9f - not in ps
	I0915 19:22:51.088706  655247 cri.go:116] container: {ID:9801458e1a86a24fcb9369b438b3075ad57794fa3390f20637c1f20d161e8041 Status:running}
	I0915 19:22:51.088716  655247 cri.go:118] skipping 9801458e1a86a24fcb9369b438b3075ad57794fa3390f20637c1f20d161e8041 - not in ps
	I0915 19:22:51.088725  655247 cri.go:116] container: {ID:add40aaf7d1e10f027cdbe1822c9e2e3a692eb9dcc9ce52c62557d8bf4504255 Status:running}
	I0915 19:22:51.088736  655247 cri.go:122] skipping {add40aaf7d1e10f027cdbe1822c9e2e3a692eb9dcc9ce52c62557d8bf4504255 running}: state = "running", want "paused"
	I0915 19:22:51.088745  655247 cri.go:116] container: {ID:af1e2cc7dc24b45471cf57358688c86eb6a2d88bd25aea200dbde73258eda494 Status:running}
	I0915 19:22:51.088751  655247 cri.go:118] skipping af1e2cc7dc24b45471cf57358688c86eb6a2d88bd25aea200dbde73258eda494 - not in ps
	I0915 19:22:51.088756  655247 cri.go:116] container: {ID:c59a5411d0a433dc24d4b92cbfe6897ccefe0c7791ebb38fa78a538f7451455a Status:running}
	I0915 19:22:51.088761  655247 cri.go:122] skipping {c59a5411d0a433dc24d4b92cbfe6897ccefe0c7791ebb38fa78a538f7451455a running}: state = "running", want "paused"
	I0915 19:22:51.088767  655247 cri.go:116] container: {ID:d9f651544d709d16c6efc0de6ada610461ff2c10ea3d5579b27bc741b194eeb4 Status:running}
	I0915 19:22:51.088773  655247 cri.go:118] skipping d9f651544d709d16c6efc0de6ada610461ff2c10ea3d5579b27bc741b194eeb4 - not in ps
	I0915 19:22:51.088777  655247 cri.go:116] container: {ID:f9a6017a48e430457074558a4f8587452f4bc9da312b0a267d9b4c66ec6698a3 Status:running}
	I0915 19:22:51.088783  655247 cri.go:122] skipping {f9a6017a48e430457074558a4f8587452f4bc9da312b0a267d9b4c66ec6698a3 running}: state = "running", want "paused"
	I0915 19:22:51.088792  655247 cri.go:116] container: {ID:ffa7fe563436a7ae8d7cecd36b9ff38df2bcc5435d8942a21f17d65219db5c80 Status:running}
	I0915 19:22:51.088798  655247 cri.go:122] skipping {ffa7fe563436a7ae8d7cecd36b9ff38df2bcc5435d8942a21f17d65219db5c80 running}: state = "running", want "paused"
	I0915 19:22:51.088844  655247 ssh_runner.go:152] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0915 19:22:51.095763  655247 kubeadm.go:401] found existing configuration files, will attempt cluster restart
	I0915 19:22:51.095785  655247 kubeadm.go:600] restartCluster start
	I0915 19:22:51.095822  655247 ssh_runner.go:152] Run: sudo test -d /data/minikube
	I0915 19:22:51.101778  655247 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0915 19:22:51.102647  655247 kubeconfig.go:93] found "pause-20210915191717-498219" server: "https://192.168.76.2:8443"
	I0915 19:22:51.103180  655247 kapi.go:59] client config for pause-20210915191717-498219: &rest.Config{Host:"https://192.168.76.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191717-498219/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191
717-498219/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1581620), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0915 19:22:51.104674  655247 ssh_runner.go:152] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0915 19:22:51.110929  655247 api_server.go:164] Checking apiserver status ...
	I0915 19:22:51.110983  655247 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0915 19:22:51.127823  655247 ssh_runner.go:152] Run: sudo egrep ^[0-9]+:freezer: /proc/1542/cgroup
	I0915 19:22:51.136935  655247 api_server.go:180] apiserver freezer: "10:freezer:/docker/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/kubepods/burstable/pod7711ec5bdcd091468467911b3afef6b2/c59a5411d0a433dc24d4b92cbfe6897ccefe0c7791ebb38fa78a538f7451455a"
	I0915 19:22:51.137003  655247 ssh_runner.go:152] Run: sudo cat /sys/fs/cgroup/freezer/docker/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/kubepods/burstable/pod7711ec5bdcd091468467911b3afef6b2/c59a5411d0a433dc24d4b92cbfe6897ccefe0c7791ebb38fa78a538f7451455a/freezer.state
	I0915 19:22:51.147644  655247 api_server.go:202] freezer state: "THAWED"
	I0915 19:22:51.147694  655247 api_server.go:239] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0915 19:22:51.162127  655247 api_server.go:265] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0915 19:22:51.179572  655247 system_pods.go:86] 7 kube-system pods found
	I0915 19:22:51.179610  655247 system_pods.go:89] "coredns-78fcd69978-87x4l" [bacedd06-5f04-410d-bb77-6d7082ac74d8] Running
	I0915 19:22:51.179619  655247 system_pods.go:89] "etcd-pause-20210915191717-498219" [0991dada-71a6-43d0-9f66-c9b25809bc2b] Running
	I0915 19:22:51.179626  655247 system_pods.go:89] "kindnet-m5zrb" [b75f582d-6b59-4a29-8f66-5670fc372ef7] Running
	I0915 19:22:51.179632  655247 system_pods.go:89] "kube-apiserver-pause-20210915191717-498219" [b443a356-bad3-43f5-adf0-a707a59b1e3e] Running
	I0915 19:22:51.179642  655247 system_pods.go:89] "kube-controller-manager-pause-20210915191717-498219" [80b9f270-d952-46f1-aaf8-fd7809c43695] Running
	I0915 19:22:51.179650  655247 system_pods.go:89] "kube-proxy-x78hq" [78449e93-ea1e-46cd-92ca-d416ecbee251] Running
	I0915 19:22:51.179656  655247 system_pods.go:89] "kube-scheduler-pause-20210915191717-498219" [a833ad01-8882-480d-96e1-2e27e2c74b24] Running
	I0915 19:22:51.180750  655247 api_server.go:139] control plane version: v1.22.1
	I0915 19:22:51.180774  655247 kubeadm.go:594] The running cluster does not require reconfiguration: 192.168.76.2
	I0915 19:22:51.180783  655247 kubeadm.go:647] Taking a shortcut, as the cluster seems to be properly configured
	I0915 19:22:51.180792  655247 kubeadm.go:604] restartCluster took 85.001937ms
	I0915 19:22:51.180798  655247 kubeadm.go:392] StartCluster complete in 164.83119ms
	I0915 19:22:51.180814  655247 settings.go:142] acquiring lock: {Name:mk259ca65137eb22f1eac8c1812f7da06160f392 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0915 19:22:51.180914  655247 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	I0915 19:22:51.182196  655247 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig: {Name:mkd61015e23f8ba8a145a0ee59bfc35c5726ad3f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0915 19:22:51.182917  655247 kapi.go:59] client config for pause-20210915191717-498219: &rest.Config{Host:"https://192.168.76.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191717-498219/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191
717-498219/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1581620), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0915 19:22:51.187050  655247 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "pause-20210915191717-498219" rescaled to 1
	I0915 19:22:51.187111  655247 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}
	I0915 19:22:51.188916  655247 out.go:177] * Verifying Kubernetes components...
	I0915 19:22:51.187189  655247 addons.go:404] enableAddons start: toEnable=map[], additional=[]
	I0915 19:22:51.187250  655247 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0915 19:22:51.187395  655247 config.go:177] Loaded profile config "pause-20210915191717-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 19:22:51.188973  655247 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
	I0915 19:22:51.189035  655247 addons.go:65] Setting storage-provisioner=true in profile "pause-20210915191717-498219"
	I0915 19:22:51.189070  655247 addons.go:153] Setting addon storage-provisioner=true in "pause-20210915191717-498219"
	W0915 19:22:51.189081  655247 addons.go:165] addon storage-provisioner should already be in state true
	I0915 19:22:51.189108  655247 host.go:66] Checking if "pause-20210915191717-498219" exists ...
	I0915 19:22:51.189043  655247 addons.go:65] Setting default-storageclass=true in profile "pause-20210915191717-498219"
	I0915 19:22:51.189165  655247 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "pause-20210915191717-498219"
	I0915 19:22:51.189453  655247 cli_runner.go:115] Run: docker container inspect pause-20210915191717-498219 --format={{.State.Status}}
	I0915 19:22:51.189655  655247 cli_runner.go:115] Run: docker container inspect pause-20210915191717-498219 --format={{.State.Status}}
	I0915 19:22:51.245585  655247 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0915 19:22:51.244357  655247 kapi.go:59] client config for pause-20210915191717-498219: &rest.Config{Host:"https://192.168.76.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191717-498219/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/pause-20210915191
717-498219/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1581620), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0915 19:22:51.245782  655247 addons.go:337] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0915 19:22:51.245813  655247 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0915 19:22:51.245872  655247 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20210915191717-498219
	I0915 19:22:51.250803  655247 addons.go:153] Setting addon default-storageclass=true in "pause-20210915191717-498219"
	W0915 19:22:51.250828  655247 addons.go:165] addon default-storageclass should already be in state true
	I0915 19:22:51.250856  655247 host.go:66] Checking if "pause-20210915191717-498219" exists ...
	I0915 19:22:51.251401  655247 cli_runner.go:115] Run: docker container inspect pause-20210915191717-498219 --format={{.State.Status}}
	I0915 19:22:51.275346  655247 node_ready.go:35] waiting up to 6m0s for node "pause-20210915191717-498219" to be "Ready" ...
	I0915 19:22:51.275515  655247 start.go:709] CoreDNS already contains "host.minikube.internal" host record, skipping...
	I0915 19:22:51.279386  655247 node_ready.go:49] node "pause-20210915191717-498219" has status "Ready":"True"
	I0915 19:22:51.279407  655247 node_ready.go:38] duration metric: took 4.008963ms waiting for node "pause-20210915191717-498219" to be "Ready" ...
	I0915 19:22:51.279418  655247 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0915 19:22:51.287816  655247 pod_ready.go:78] waiting up to 6m0s for pod "coredns-78fcd69978-87x4l" in "kube-system" namespace to be "Ready" ...
	I0915 19:22:51.298854  655247 pod_ready.go:92] pod "coredns-78fcd69978-87x4l" in "kube-system" namespace has status "Ready":"True"
	I0915 19:22:51.298878  655247 pod_ready.go:81] duration metric: took 10.989017ms waiting for pod "coredns-78fcd69978-87x4l" in "kube-system" namespace to be "Ready" ...
	I0915 19:22:51.298893  655247 pod_ready.go:78] waiting up to 6m0s for pod "etcd-pause-20210915191717-498219" in "kube-system" namespace to be "Ready" ...
	I0915 19:22:51.310531  655247 pod_ready.go:92] pod "etcd-pause-20210915191717-498219" in "kube-system" namespace has status "Ready":"True"
	I0915 19:22:51.310553  655247 pod_ready.go:81] duration metric: took 11.651811ms waiting for pod "etcd-pause-20210915191717-498219" in "kube-system" namespace to be "Ready" ...
	I0915 19:22:51.310572  655247 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-pause-20210915191717-498219" in "kube-system" namespace to be "Ready" ...
	I0915 19:22:51.311136  655247 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33158 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/pause-20210915191717-498219/id_rsa Username:docker}
	I0915 19:22:51.313549  655247 addons.go:337] installing /etc/kubernetes/addons/storageclass.yaml
	I0915 19:22:51.313571  655247 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0915 19:22:51.313624  655247 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20210915191717-498219
	I0915 19:22:51.315768  655247 pod_ready.go:92] pod "kube-apiserver-pause-20210915191717-498219" in "kube-system" namespace has status "Ready":"True"
	I0915 19:22:51.315786  655247 pod_ready.go:81] duration metric: took 5.205798ms waiting for pod "kube-apiserver-pause-20210915191717-498219" in "kube-system" namespace to be "Ready" ...
	I0915 19:22:51.315799  655247 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-pause-20210915191717-498219" in "kube-system" namespace to be "Ready" ...
	I0915 19:22:51.366388  655247 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33158 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/pause-20210915191717-498219/id_rsa Username:docker}
	I0915 19:22:51.366460  655247 pod_ready.go:92] pod "kube-controller-manager-pause-20210915191717-498219" in "kube-system" namespace has status "Ready":"True"
	I0915 19:22:51.366478  655247 pod_ready.go:81] duration metric: took 50.671787ms waiting for pod "kube-controller-manager-pause-20210915191717-498219" in "kube-system" namespace to be "Ready" ...
	I0915 19:22:51.366489  655247 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-x78hq" in "kube-system" namespace to be "Ready" ...
	I0915 19:22:51.415448  655247 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0915 19:22:51.459814  655247 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0915 19:22:51.704165  655247 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0915 19:22:51.704194  655247 addons.go:406] enableAddons completed in 517.020355ms
	I0915 19:22:51.765858  655247 pod_ready.go:92] pod "kube-proxy-x78hq" in "kube-system" namespace has status "Ready":"True"
	I0915 19:22:51.765881  655247 pod_ready.go:81] duration metric: took 399.383815ms waiting for pod "kube-proxy-x78hq" in "kube-system" namespace to be "Ready" ...
	I0915 19:22:51.765892  655247 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-pause-20210915191717-498219" in "kube-system" namespace to be "Ready" ...
	I0915 19:22:50.328687  649792 ssh_runner.go:192] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/etcd_3.5.0-0: (6.672571644s)
	I0915 19:22:50.328788  649792 containerd.go:305] Loading image: /var/lib/minikube/images/coredns_v1.8.4
	I0915 19:22:50.328839  649792 ssh_runner.go:152] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/coredns_v1.8.4
	I0915 19:22:50.662340  649792 cache_images.go:309] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns/coredns_v1.8.4 from cache
	I0915 19:22:50.662388  649792 containerd.go:305] Loading image: /var/lib/minikube/images/metrics-scraper_v1.0.4
	I0915 19:22:50.662433  649792 ssh_runner.go:152] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/metrics-scraper_v1.0.4
	I0915 19:22:51.844957  649792 ssh_runner.go:192] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/metrics-scraper_v1.0.4: (1.182484735s)
	I0915 19:22:51.844989  649792 cache_images.go:309] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4 from cache
	I0915 19:22:51.845033  649792 cache_images.go:86] LoadImages completed in 31.423759154s
	W0915 19:22:51.845195  649792 out.go:242] X Unable to load cached images: loading cached images: removing image: crictl: sudo /usr/bin/crictl rmi k8s.gcr.io/pause:3.5: Process exited with status 1
	stdout:
	
	stderr:
	time="2021-09-15T19:22:21Z" level=error msg="image status request for \"k8s.gcr.io/pause:3.5\" failed: rpc error: code = Unknown desc = server is not initialized yet"
	time="2021-09-15T19:22:21Z" level=fatal msg="unable to remove the image(s)"
	
	I0915 19:22:51.845249  649792 ssh_runner.go:152] Run: sudo crictl info
	I0915 19:22:51.873314  649792 cni.go:93] Creating CNI manager for ""
	I0915 19:22:51.873340  649792 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet
	I0915 19:22:51.873356  649792 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0915 19:22:51.873375  649792 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.22.2-rc.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kubernetes-upgrade-20210915191929-498219 NodeName:kubernetes-upgrade-20210915191929-498219 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 Cgroup
Driver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
	I0915 19:22:51.873535  649792 kubeadm.go:157] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "kubernetes-upgrade-20210915191929-498219"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.22.2-rc.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0915 19:22:51.873656  649792 kubeadm.go:909] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.22.2-rc.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cni-conf-dir=/etc/cni/net.mk --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=kubernetes-upgrade-20210915191929-498219 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.49.2 --runtime-request-timeout=15m
	
	[Install]
	 config:
	{KubernetesVersion:v1.22.2-rc.0 ClusterName:kubernetes-upgrade-20210915191929-498219 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0915 19:22:51.873718  649792 ssh_runner.go:152] Run: sudo ls /var/lib/minikube/binaries/v1.22.2-rc.0
	I0915 19:22:51.880755  649792 binaries.go:44] Found k8s binaries, skipping transfer
	I0915 19:22:51.880824  649792 ssh_runner.go:152] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0915 19:22:51.887482  649792 ssh_runner.go:319] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (590 bytes)
	I0915 19:22:51.899701  649792 ssh_runner.go:319] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
	I0915 19:22:51.911652  649792 ssh_runner.go:319] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2095 bytes)
	I0915 19:22:51.936389  649792 ssh_runner.go:152] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0915 19:22:51.939903  649792 certs.go:52] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubernetes-upgrade-20210915191929-498219 for IP: 192.168.49.2
	I0915 19:22:51.939957  649792 certs.go:179] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.key
	I0915 19:22:51.939977  649792 certs.go:179] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/proxy-client-ca.key
	I0915 19:22:51.940039  649792 certs.go:293] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubernetes-upgrade-20210915191929-498219/client.key
	I0915 19:22:51.940061  649792 certs.go:293] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubernetes-upgrade-20210915191929-498219/apiserver.key.dd3b5fb2
	I0915 19:22:51.940083  649792 certs.go:293] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubernetes-upgrade-20210915191929-498219/proxy-client.key
	I0915 19:22:51.940250  649792 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/498219.pem (1338 bytes)
	W0915 19:22:51.940299  649792 certs.go:372] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/498219_empty.pem, impossibly tiny 0 bytes
	I0915 19:22:51.940328  649792 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem (1679 bytes)
	I0915 19:22:51.940361  649792 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem (1082 bytes)
	I0915 19:22:51.940392  649792 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem (1123 bytes)
	I0915 19:22:51.940419  649792 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/key.pem (1679 bytes)
	I0915 19:22:51.940467  649792 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/4982192.pem (1708 bytes)
	I0915 19:22:51.941664  649792 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubernetes-upgrade-20210915191929-498219/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0915 19:22:51.968231  649792 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubernetes-upgrade-20210915191929-498219/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0915 19:22:52.033843  649792 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubernetes-upgrade-20210915191929-498219/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0915 19:22:52.052902  649792 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubernetes-upgrade-20210915191929-498219/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0915 19:22:52.071678  649792 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0915 19:22:52.091688  649792 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0915 19:22:52.153544  649792 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0915 19:22:52.181305  649792 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0915 19:22:52.200975  649792 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/4982192.pem --> /usr/share/ca-certificates/4982192.pem (1708 bytes)
	I0915 19:22:52.237130  649792 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0915 19:22:52.265080  649792 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/498219.pem --> /usr/share/ca-certificates/498219.pem (1338 bytes)
	I0915 19:22:52.289750  649792 ssh_runner.go:319] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0915 19:22:52.302871  649792 ssh_runner.go:152] Run: openssl version
	I0915 19:22:52.307556  649792 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4982192.pem && ln -fs /usr/share/ca-certificates/4982192.pem /etc/ssl/certs/4982192.pem"
	I0915 19:22:52.315369  649792 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/4982192.pem
	I0915 19:22:52.318752  649792 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Sep 15 18:47 /usr/share/ca-certificates/4982192.pem
	I0915 19:22:52.318811  649792 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4982192.pem
	I0915 19:22:52.327738  649792 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/4982192.pem /etc/ssl/certs/3ec20f2e.0"
	I0915 19:22:52.338277  649792 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0915 19:22:52.348439  649792 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0915 19:22:52.352776  649792 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Sep 15 18:42 /usr/share/ca-certificates/minikubeCA.pem
	I0915 19:22:52.352834  649792 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0915 19:22:52.360330  649792 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0915 19:22:52.368589  649792 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/498219.pem && ln -fs /usr/share/ca-certificates/498219.pem /etc/ssl/certs/498219.pem"
	I0915 19:22:52.376277  649792 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/498219.pem
	I0915 19:22:52.379233  649792 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Sep 15 18:47 /usr/share/ca-certificates/498219.pem
	I0915 19:22:52.379278  649792 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/498219.pem
	I0915 19:22:52.384045  649792 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/498219.pem /etc/ssl/certs/51391683.0"
	I0915 19:22:52.391118  649792 kubeadm.go:390] StartCluster: {Name:kubernetes-upgrade-20210915191929-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.2-rc.0 ClusterName:kubernetes-upgrade-20210915191929-498219 Namespace:default APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.22.2-rc.0 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisione
r:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 19:22:52.391232  649792 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0915 19:22:52.391282  649792 ssh_runner.go:152] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0915 19:22:52.418893  649792 cri.go:76] found id: "33028d009d4822736870f91311ab8db7cc8de6701ffd4d3a13f09e8df478e91b"
	I0915 19:22:52.418920  649792 cri.go:76] found id: "494037220cc8ed5b615bd0df0cbbec42be4d87b871ac7eddc0c2601f09b3d210"
	I0915 19:22:52.418928  649792 cri.go:76] found id: "3bc801d79d3559f0ea1454c056e649260f4d92e1049a0fc928e36c980530fd5f"
	I0915 19:22:52.418935  649792 cri.go:76] found id: "60263fb86f01a3fc68a81d043facc611f377b2f483975040fa1aa6270724e0a0"
	I0915 19:22:52.418942  649792 cri.go:76] found id: "08f53dec095825127d8dcac9425f6405613faa3b569bc4f4f61d622f422b627e"
	I0915 19:22:52.418950  649792 cri.go:76] found id: "d5512d3b572a55438845f894eacb58c95e834bc306d7e4bbe27fd3bd1fa9620f"
	I0915 19:22:52.418956  649792 cri.go:76] found id: "6320efe1893f7b0a09d571930f73ce8d35dd0999f6098037a2c66caf60488f21"
	I0915 19:22:52.418963  649792 cri.go:76] found id: "2e68a83a2a5925444239738b8feb23561b65f96fedb44f261b770d8743e40fbb"
	I0915 19:22:52.418973  649792 cri.go:76] found id: "c2b7023f330c19c238714efdce30d4ad5ed1b19271c3f97b7985f89b0e5c551e"
	I0915 19:22:52.418984  649792 cri.go:76] found id: ""
	I0915 19:22:52.419034  649792 ssh_runner.go:152] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0915 19:22:52.475614  649792 cri.go:103] JSON = [{"ociVersion":"1.0.2-dev","id":"020eae8b264fb7e977d123279e4f6fbe9f592d7e9334fda106f115858dfc828c","pid":3346,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/020eae8b264fb7e977d123279e4f6fbe9f592d7e9334fda106f115858dfc828c","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/020eae8b264fb7e977d123279e4f6fbe9f592d7e9334fda106f115858dfc828c/rootfs","created":"2021-09-15T19:22:37.127579Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"020eae8b264fb7e977d123279e4f6fbe9f592d7e9334fda106f115858dfc828c","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-apiserver-kubernetes-upgrade-20210915191929-498219_993488a724f365272c92aef5f4892e6e"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"08f53dec095825127d8dcac9425f6405613faa3b569bc4f4f61d622f422b627e","pid":3967,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/08f53de
c095825127d8dcac9425f6405613faa3b569bc4f4f61d622f422b627e","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/08f53dec095825127d8dcac9425f6405613faa3b569bc4f4f61d622f422b627e/rootfs","created":"2021-09-15T19:22:47.711526597Z","annotations":{"io.kubernetes.cri.container-name":"storage-provisioner","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"323d53c493a5b98461177ef2507fb5507e7d48f452f2dcf252237ab60d39b1dc"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1823b13acfbd91d51c0559c452f67f4b0b366a57962f3f286010f44b9b97ecee","pid":1667,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1823b13acfbd91d51c0559c452f67f4b0b366a57962f3f286010f44b9b97ecee","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1823b13acfbd91d51c0559c452f67f4b0b366a57962f3f286010f44b9b97ecee/rootfs","created":"2021-09-15T19:21:46.8076425Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"1823b13acfbd91d51c0559c452
f67f4b0b366a57962f3f286010f44b9b97ecee","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kindnet-dwt9k_f26e50eb-1659-11ec-84b6-024286fc7576"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1af1fc9bcb89675319d086f2d7cf92383c496b0df808371d74e8133a333f2ccc","pid":2376,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1af1fc9bcb89675319d086f2d7cf92383c496b0df808371d74e8133a333f2ccc","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1af1fc9bcb89675319d086f2d7cf92383c496b0df808371d74e8133a333f2ccc/rootfs","created":"2021-09-15T19:22:00.367732218Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"1af1fc9bcb89675319d086f2d7cf92383c496b0df808371d74e8133a333f2ccc","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_coredns-78fcd69978-dkbpl_22ed48aa-dcad-4573-9e14-e55f056f63f2"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"2e68a83a2a5925444239738b8feb23561b65f96fedb44f261b770d8743e40fbb","pid"
:3533,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/2e68a83a2a5925444239738b8feb23561b65f96fedb44f261b770d8743e40fbb","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/2e68a83a2a5925444239738b8feb23561b65f96fedb44f261b770d8743e40fbb/rootfs","created":"2021-09-15T19:22:37.727692836Z","annotations":{"io.kubernetes.cri.container-name":"kube-proxy","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"ca8be3f646b282688d0818b200cbf0f6793b76dc59234280438c64692ce0421c"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"323d53c493a5b98461177ef2507fb5507e7d48f452f2dcf252237ab60d39b1dc","pid":3385,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/323d53c493a5b98461177ef2507fb5507e7d48f452f2dcf252237ab60d39b1dc","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/323d53c493a5b98461177ef2507fb5507e7d48f452f2dcf252237ab60d39b1dc/rootfs","created":"2021-09-15T19:22:37.427624703Z","annotations":{"io.kubernetes.
cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"323d53c493a5b98461177ef2507fb5507e7d48f452f2dcf252237ab60d39b1dc","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_storage-provisioner_e6d9c474-1659-11ec-84b6-024286fc7576"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"3443df9c452859c84242fc047708f2e53711b2a142c70fbdd1ee4917d924e1f5","pid":2270,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/3443df9c452859c84242fc047708f2e53711b2a142c70fbdd1ee4917d924e1f5","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/3443df9c452859c84242fc047708f2e53711b2a142c70fbdd1ee4917d924e1f5/rootfs","created":"2021-09-15T19:22:00.023695164Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"3443df9c452859c84242fc047708f2e53711b2a142c70fbdd1ee4917d924e1f5","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_storage-provisioner_e6d9c474-1659-11ec-84b6-024286fc7576"},"owner":"root"},{"ociVersion":
"1.0.2-dev","id":"37776b490ef99a2f64f076ba514272e49f538a282445c9ed875cec32aef300e2","pid":3035,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/37776b490ef99a2f64f076ba514272e49f538a282445c9ed875cec32aef300e2","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/37776b490ef99a2f64f076ba514272e49f538a282445c9ed875cec32aef300e2/rootfs","created":"2021-09-15T19:22:36.139685643Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"37776b490ef99a2f64f076ba514272e49f538a282445c9ed875cec32aef300e2","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-scheduler-kubernetes-upgrade-20210915191929-498219_6f0c8e6f6bfa317289f77ae98c8c54dd"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"37b3a175de7c18cb6cd60f2513df66dc74965e0e1e626c2a8f7cc9846486424a","pid":3415,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/37b3a175de7c18cb6cd60f2513df66dc74965e0e1e626c2a8f7cc9846486424a","rootfs":"/
run/containerd/io.containerd.runtime.v2.task/k8s.io/37b3a175de7c18cb6cd60f2513df66dc74965e0e1e626c2a8f7cc9846486424a/rootfs","created":"2021-09-15T19:22:37.527567782Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"37b3a175de7c18cb6cd60f2513df66dc74965e0e1e626c2a8f7cc9846486424a","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kindnet-dwt9k_f26e50eb-1659-11ec-84b6-024286fc7576"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"3bc801d79d3559f0ea1454c056e649260f4d92e1049a0fc928e36c980530fd5f","pid":4067,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/3bc801d79d3559f0ea1454c056e649260f4d92e1049a0fc928e36c980530fd5f","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/3bc801d79d3559f0ea1454c056e649260f4d92e1049a0fc928e36c980530fd5f/rootfs","created":"2021-09-15T19:22:49.927717203Z","annotations":{"io.kubernetes.cri.container-name":"coredns","io.kubernetes.cri.container-type":"container","io.kubernetes.cr
i.sandbox-id":"f3cb259e200409b2c56e9d0899c2db2a5dfa79379c49c175adc4db2dd0aa27dd"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"6035c94074b23c2a95b478ceb3b744262f5704771a8d87669733977c476a5a25","pid":1353,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/6035c94074b23c2a95b478ceb3b744262f5704771a8d87669733977c476a5a25","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/6035c94074b23c2a95b478ceb3b744262f5704771a8d87669733977c476a5a25/rootfs","created":"2021-09-15T19:21:37.853039891Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"6035c94074b23c2a95b478ceb3b744262f5704771a8d87669733977c476a5a25","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-scheduler-kubernetes-upgrade-20210915191929-498219_6f0c8e6f6bfa317289f77ae98c8c54dd"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"60f1cf0796d24b39954528eca0b88ae172b04eab752cda2cd2d6ad021cd6eb4d","pid":1584,"status":"running","bundle":"/run/containerd/io
.containerd.runtime.v2.task/k8s.io/60f1cf0796d24b39954528eca0b88ae172b04eab752cda2cd2d6ad021cd6eb4d","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/60f1cf0796d24b39954528eca0b88ae172b04eab752cda2cd2d6ad021cd6eb4d/rootfs","created":"2021-09-15T19:21:45.576393508Z","annotations":{"io.kubernetes.cri.container-name":"kube-controller-manager","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"a11b0bc5218c937aeabad9ccaf405c26663a15b66fb7d4fe6376e03ff46c3f7d"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"6320efe1893f7b0a09d571930f73ce8d35dd0999f6098037a2c66caf60488f21","pid":3609,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/6320efe1893f7b0a09d571930f73ce8d35dd0999f6098037a2c66caf60488f21","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/6320efe1893f7b0a09d571930f73ce8d35dd0999f6098037a2c66caf60488f21/rootfs","created":"2021-09-15T19:22:38.255645552Z","annotations":{"io.kubernetes.cri.container-name":"kindnet-cni","io.ku
bernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"37b3a175de7c18cb6cd60f2513df66dc74965e0e1e626c2a8f7cc9846486424a"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"80574caaa7925d01e87089240ef3b7af8b94b7744f512d92adceac4849db51da","pid":1532,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/80574caaa7925d01e87089240ef3b7af8b94b7744f512d92adceac4849db51da","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/80574caaa7925d01e87089240ef3b7af8b94b7744f512d92adceac4849db51da/rootfs","created":"2021-09-15T19:21:42.279668598Z","annotations":{"io.kubernetes.cri.container-name":"kube-scheduler","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"6035c94074b23c2a95b478ceb3b744262f5704771a8d87669733977c476a5a25"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"a11b0bc5218c937aeabad9ccaf405c26663a15b66fb7d4fe6376e03ff46c3f7d","pid":1352,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/a11b0bc5218c
937aeabad9ccaf405c26663a15b66fb7d4fe6376e03ff46c3f7d","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/a11b0bc5218c937aeabad9ccaf405c26663a15b66fb7d4fe6376e03ff46c3f7d/rootfs","created":"2021-09-15T19:21:37.851625355Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"a11b0bc5218c937aeabad9ccaf405c26663a15b66fb7d4fe6376e03ff46c3f7d","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-controller-manager-kubernetes-upgrade-20210915191929-498219_a7b9b3777376e55f29d251d898f133be"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"a80fd0150bc9a3fd0c4a181d12abdf5e8ab32b72ee3d0a3c8494cc6851301b28","pid":1482,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/a80fd0150bc9a3fd0c4a181d12abdf5e8ab32b72ee3d0a3c8494cc6851301b28","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/a80fd0150bc9a3fd0c4a181d12abdf5e8ab32b72ee3d0a3c8494cc6851301b28/rootfs","created":"2021-09-15T19:21:40.40369172Z","annotations"
:{"io.kubernetes.cri.container-name":"kube-apiserver","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"bd247913b9057e388192f3be610eb932fd4d3a43a60207c47393814ae50643bc"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"b05f472b7479102a3aca18f8ad42bbbcce6b9de95e210831bb3c94476cd69748","pid":2421,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b05f472b7479102a3aca18f8ad42bbbcce6b9de95e210831bb3c94476cd69748","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b05f472b7479102a3aca18f8ad42bbbcce6b9de95e210831bb3c94476cd69748/rootfs","created":"2021-09-15T19:22:00.619582527Z","annotations":{"io.kubernetes.cri.container-name":"coredns","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"1af1fc9bcb89675319d086f2d7cf92383c496b0df808371d74e8133a333f2ccc"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"b1ac8d59ca99c89b39441114c26b0402c9e5917ecfcd4c8d3d41ab7c9629d092","pid":1422,"status":"running","bundle":"/run/contain
erd/io.containerd.runtime.v2.task/k8s.io/b1ac8d59ca99c89b39441114c26b0402c9e5917ecfcd4c8d3d41ab7c9629d092","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b1ac8d59ca99c89b39441114c26b0402c9e5917ecfcd4c8d3d41ab7c9629d092/rootfs","created":"2021-09-15T19:21:38.151575578Z","annotations":{"io.kubernetes.cri.container-name":"etcd","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"c0859fa98a021bf982b4c87e7b58a65f108725a9bea87e004c6b1c94789ea1c6"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"bd247913b9057e388192f3be610eb932fd4d3a43a60207c47393814ae50643bc","pid":1351,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/bd247913b9057e388192f3be610eb932fd4d3a43a60207c47393814ae50643bc","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/bd247913b9057e388192f3be610eb932fd4d3a43a60207c47393814ae50643bc/rootfs","created":"2021-09-15T19:21:37.851894479Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sand
box-id":"bd247913b9057e388192f3be610eb932fd4d3a43a60207c47393814ae50643bc","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-apiserver-kubernetes-upgrade-20210915191929-498219_993488a724f365272c92aef5f4892e6e"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"c0859fa98a021bf982b4c87e7b58a65f108725a9bea87e004c6b1c94789ea1c6","pid":1367,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/c0859fa98a021bf982b4c87e7b58a65f108725a9bea87e004c6b1c94789ea1c6","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/c0859fa98a021bf982b4c87e7b58a65f108725a9bea87e004c6b1c94789ea1c6/rootfs","created":"2021-09-15T19:21:37.8516583Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"c0859fa98a021bf982b4c87e7b58a65f108725a9bea87e004c6b1c94789ea1c6","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_etcd-kubernetes-upgrade-20210915191929-498219_aa47ce6ae607f6d51d072afb546a8993"},"owner":"root"},{"ociVersion":"
1.0.2-dev","id":"ca545d48dd4e45e5688401e4e8a94c2c47b84c014186a531718821246353e7ad","pid":2507,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/ca545d48dd4e45e5688401e4e8a94c2c47b84c014186a531718821246353e7ad","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/ca545d48dd4e45e5688401e4e8a94c2c47b84c014186a531718821246353e7ad/rootfs","created":"2021-09-15T19:22:01.639651674Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"ca545d48dd4e45e5688401e4e8a94c2c47b84c014186a531718821246353e7ad","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-proxy-b5jfk_6d850bd3-3da2-4859-ae8e-ae44340d2f4f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"ca8be3f646b282688d0818b200cbf0f6793b76dc59234280438c64692ce0421c","pid":3289,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/ca8be3f646b282688d0818b200cbf0f6793b76dc59234280438c64692ce0421c","rootfs":"/run/containerd/io.containerd.runtime
.v2.task/k8s.io/ca8be3f646b282688d0818b200cbf0f6793b76dc59234280438c64692ce0421c/rootfs","created":"2021-09-15T19:22:37.056058003Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"ca8be3f646b282688d0818b200cbf0f6793b76dc59234280438c64692ce0421c","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-proxy-b5jfk_6d850bd3-3da2-4859-ae8e-ae44340d2f4f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"d2df18d8aab107fe93a00e410e622431d2bcfdb43f30668a27ee56acc99b0860","pid":3384,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/d2df18d8aab107fe93a00e410e622431d2bcfdb43f30668a27ee56acc99b0860","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/d2df18d8aab107fe93a00e410e622431d2bcfdb43f30668a27ee56acc99b0860/rootfs","created":"2021-09-15T19:22:37.24798955Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"d2df18d8aab107fe93a00e410e622431d2bcfdb43f30668a27ee56acc99b0860",
"io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_etcd-kubernetes-upgrade-20210915191929-498219_aa47ce6ae607f6d51d072afb546a8993"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"d9c387e670453fe79a2209f6b1697be6313d02c0697b5bfbd614458f904b70c5","pid":1706,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/d9c387e670453fe79a2209f6b1697be6313d02c0697b5bfbd614458f904b70c5","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/d9c387e670453fe79a2209f6b1697be6313d02c0697b5bfbd614458f904b70c5/rootfs","created":"2021-09-15T19:21:47.391893436Z","annotations":{"io.kubernetes.cri.container-name":"kindnet-cni","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"1823b13acfbd91d51c0559c452f67f4b0b366a57962f3f286010f44b9b97ecee"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"e0d519ccd18046aa80c8000d729f1c82e760780b7b41555d00e4099486ab55e1","pid":3034,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/e0d51
9ccd18046aa80c8000d729f1c82e760780b7b41555d00e4099486ab55e1","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/e0d519ccd18046aa80c8000d729f1c82e760780b7b41555d00e4099486ab55e1/rootfs","created":"2021-09-15T19:22:36.139555904Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"e0d519ccd18046aa80c8000d729f1c82e760780b7b41555d00e4099486ab55e1","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-controller-manager-kubernetes-upgrade-20210915191929-498219_a7b9b3777376e55f29d251d898f133be"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"f3cb259e200409b2c56e9d0899c2db2a5dfa79379c49c175adc4db2dd0aa27dd","pid":3481,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/f3cb259e200409b2c56e9d0899c2db2a5dfa79379c49c175adc4db2dd0aa27dd","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/f3cb259e200409b2c56e9d0899c2db2a5dfa79379c49c175adc4db2dd0aa27dd/rootfs","created":"2021-09-15T19:22:37.583555377Z","anno
tations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"f3cb259e200409b2c56e9d0899c2db2a5dfa79379c49c175adc4db2dd0aa27dd","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_coredns-78fcd69978-dkbpl_22ed48aa-dcad-4573-9e14-e55f056f63f2"},"owner":"root"}]
	I0915 19:22:52.475876  649792 cri.go:113] list returned 26 containers
	I0915 19:22:52.475891  649792 cri.go:116] container: {ID:020eae8b264fb7e977d123279e4f6fbe9f592d7e9334fda106f115858dfc828c Status:running}
	I0915 19:22:52.475910  649792 cri.go:118] skipping 020eae8b264fb7e977d123279e4f6fbe9f592d7e9334fda106f115858dfc828c - not in ps
	I0915 19:22:52.475915  649792 cri.go:116] container: {ID:08f53dec095825127d8dcac9425f6405613faa3b569bc4f4f61d622f422b627e Status:running}
	I0915 19:22:52.475923  649792 cri.go:122] skipping {08f53dec095825127d8dcac9425f6405613faa3b569bc4f4f61d622f422b627e running}: state = "running", want "paused"
	I0915 19:22:52.475938  649792 cri.go:116] container: {ID:1823b13acfbd91d51c0559c452f67f4b0b366a57962f3f286010f44b9b97ecee Status:running}
	I0915 19:22:52.475945  649792 cri.go:118] skipping 1823b13acfbd91d51c0559c452f67f4b0b366a57962f3f286010f44b9b97ecee - not in ps
	I0915 19:22:52.475954  649792 cri.go:116] container: {ID:1af1fc9bcb89675319d086f2d7cf92383c496b0df808371d74e8133a333f2ccc Status:running}
	I0915 19:22:52.475964  649792 cri.go:118] skipping 1af1fc9bcb89675319d086f2d7cf92383c496b0df808371d74e8133a333f2ccc - not in ps
	I0915 19:22:52.475972  649792 cri.go:116] container: {ID:2e68a83a2a5925444239738b8feb23561b65f96fedb44f261b770d8743e40fbb Status:running}
	I0915 19:22:52.475978  649792 cri.go:122] skipping {2e68a83a2a5925444239738b8feb23561b65f96fedb44f261b770d8743e40fbb running}: state = "running", want "paused"
	I0915 19:22:52.475987  649792 cri.go:116] container: {ID:323d53c493a5b98461177ef2507fb5507e7d48f452f2dcf252237ab60d39b1dc Status:running}
	I0915 19:22:52.475994  649792 cri.go:118] skipping 323d53c493a5b98461177ef2507fb5507e7d48f452f2dcf252237ab60d39b1dc - not in ps
	I0915 19:22:52.476000  649792 cri.go:116] container: {ID:3443df9c452859c84242fc047708f2e53711b2a142c70fbdd1ee4917d924e1f5 Status:running}
	I0915 19:22:52.476009  649792 cri.go:118] skipping 3443df9c452859c84242fc047708f2e53711b2a142c70fbdd1ee4917d924e1f5 - not in ps
	I0915 19:22:52.476014  649792 cri.go:116] container: {ID:37776b490ef99a2f64f076ba514272e49f538a282445c9ed875cec32aef300e2 Status:running}
	I0915 19:22:52.476023  649792 cri.go:118] skipping 37776b490ef99a2f64f076ba514272e49f538a282445c9ed875cec32aef300e2 - not in ps
	I0915 19:22:52.476028  649792 cri.go:116] container: {ID:37b3a175de7c18cb6cd60f2513df66dc74965e0e1e626c2a8f7cc9846486424a Status:running}
	I0915 19:22:52.476036  649792 cri.go:118] skipping 37b3a175de7c18cb6cd60f2513df66dc74965e0e1e626c2a8f7cc9846486424a - not in ps
	I0915 19:22:52.476042  649792 cri.go:116] container: {ID:3bc801d79d3559f0ea1454c056e649260f4d92e1049a0fc928e36c980530fd5f Status:running}
	I0915 19:22:52.476051  649792 cri.go:122] skipping {3bc801d79d3559f0ea1454c056e649260f4d92e1049a0fc928e36c980530fd5f running}: state = "running", want "paused"
	I0915 19:22:52.476059  649792 cri.go:116] container: {ID:6035c94074b23c2a95b478ceb3b744262f5704771a8d87669733977c476a5a25 Status:running}
	I0915 19:22:52.476066  649792 cri.go:118] skipping 6035c94074b23c2a95b478ceb3b744262f5704771a8d87669733977c476a5a25 - not in ps
	I0915 19:22:52.476073  649792 cri.go:116] container: {ID:60f1cf0796d24b39954528eca0b88ae172b04eab752cda2cd2d6ad021cd6eb4d Status:running}
	I0915 19:22:52.476080  649792 cri.go:118] skipping 60f1cf0796d24b39954528eca0b88ae172b04eab752cda2cd2d6ad021cd6eb4d - not in ps
	I0915 19:22:52.476087  649792 cri.go:116] container: {ID:6320efe1893f7b0a09d571930f73ce8d35dd0999f6098037a2c66caf60488f21 Status:running}
	I0915 19:22:52.476093  649792 cri.go:122] skipping {6320efe1893f7b0a09d571930f73ce8d35dd0999f6098037a2c66caf60488f21 running}: state = "running", want "paused"
	I0915 19:22:52.476101  649792 cri.go:116] container: {ID:80574caaa7925d01e87089240ef3b7af8b94b7744f512d92adceac4849db51da Status:running}
	I0915 19:22:52.476107  649792 cri.go:118] skipping 80574caaa7925d01e87089240ef3b7af8b94b7744f512d92adceac4849db51da - not in ps
	I0915 19:22:52.476113  649792 cri.go:116] container: {ID:a11b0bc5218c937aeabad9ccaf405c26663a15b66fb7d4fe6376e03ff46c3f7d Status:running}
	I0915 19:22:52.476121  649792 cri.go:118] skipping a11b0bc5218c937aeabad9ccaf405c26663a15b66fb7d4fe6376e03ff46c3f7d - not in ps
	I0915 19:22:52.476127  649792 cri.go:116] container: {ID:a80fd0150bc9a3fd0c4a181d12abdf5e8ab32b72ee3d0a3c8494cc6851301b28 Status:running}
	I0915 19:22:52.476135  649792 cri.go:118] skipping a80fd0150bc9a3fd0c4a181d12abdf5e8ab32b72ee3d0a3c8494cc6851301b28 - not in ps
	I0915 19:22:52.476140  649792 cri.go:116] container: {ID:b05f472b7479102a3aca18f8ad42bbbcce6b9de95e210831bb3c94476cd69748 Status:running}
	I0915 19:22:52.476148  649792 cri.go:118] skipping b05f472b7479102a3aca18f8ad42bbbcce6b9de95e210831bb3c94476cd69748 - not in ps
	I0915 19:22:52.476154  649792 cri.go:116] container: {ID:b1ac8d59ca99c89b39441114c26b0402c9e5917ecfcd4c8d3d41ab7c9629d092 Status:running}
	I0915 19:22:52.476162  649792 cri.go:118] skipping b1ac8d59ca99c89b39441114c26b0402c9e5917ecfcd4c8d3d41ab7c9629d092 - not in ps
	I0915 19:22:52.476167  649792 cri.go:116] container: {ID:bd247913b9057e388192f3be610eb932fd4d3a43a60207c47393814ae50643bc Status:running}
	I0915 19:22:52.476177  649792 cri.go:118] skipping bd247913b9057e388192f3be610eb932fd4d3a43a60207c47393814ae50643bc - not in ps
	I0915 19:22:52.476185  649792 cri.go:116] container: {ID:c0859fa98a021bf982b4c87e7b58a65f108725a9bea87e004c6b1c94789ea1c6 Status:running}
	I0915 19:22:52.476194  649792 cri.go:118] skipping c0859fa98a021bf982b4c87e7b58a65f108725a9bea87e004c6b1c94789ea1c6 - not in ps
	I0915 19:22:52.476201  649792 cri.go:116] container: {ID:ca545d48dd4e45e5688401e4e8a94c2c47b84c014186a531718821246353e7ad Status:running}
	I0915 19:22:52.476208  649792 cri.go:118] skipping ca545d48dd4e45e5688401e4e8a94c2c47b84c014186a531718821246353e7ad - not in ps
	I0915 19:22:52.476213  649792 cri.go:116] container: {ID:ca8be3f646b282688d0818b200cbf0f6793b76dc59234280438c64692ce0421c Status:running}
	I0915 19:22:52.476221  649792 cri.go:118] skipping ca8be3f646b282688d0818b200cbf0f6793b76dc59234280438c64692ce0421c - not in ps
	I0915 19:22:52.476226  649792 cri.go:116] container: {ID:d2df18d8aab107fe93a00e410e622431d2bcfdb43f30668a27ee56acc99b0860 Status:running}
	I0915 19:22:52.476235  649792 cri.go:118] skipping d2df18d8aab107fe93a00e410e622431d2bcfdb43f30668a27ee56acc99b0860 - not in ps
	I0915 19:22:52.476240  649792 cri.go:116] container: {ID:d9c387e670453fe79a2209f6b1697be6313d02c0697b5bfbd614458f904b70c5 Status:running}
	I0915 19:22:52.476248  649792 cri.go:118] skipping d9c387e670453fe79a2209f6b1697be6313d02c0697b5bfbd614458f904b70c5 - not in ps
	I0915 19:22:52.476254  649792 cri.go:116] container: {ID:e0d519ccd18046aa80c8000d729f1c82e760780b7b41555d00e4099486ab55e1 Status:running}
	I0915 19:22:52.476262  649792 cri.go:118] skipping e0d519ccd18046aa80c8000d729f1c82e760780b7b41555d00e4099486ab55e1 - not in ps
	I0915 19:22:52.476267  649792 cri.go:116] container: {ID:f3cb259e200409b2c56e9d0899c2db2a5dfa79379c49c175adc4db2dd0aa27dd Status:running}
	I0915 19:22:52.476275  649792 cri.go:118] skipping f3cb259e200409b2c56e9d0899c2db2a5dfa79379c49c175adc4db2dd0aa27dd - not in ps
	I0915 19:22:52.476323  649792 ssh_runner.go:152] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0915 19:22:52.483709  649792 kubeadm.go:401] found existing configuration files, will attempt cluster restart
	I0915 19:22:52.483734  649792 kubeadm.go:600] restartCluster start
	I0915 19:22:52.483781  649792 ssh_runner.go:152] Run: sudo test -d /data/minikube
	I0915 19:22:52.490196  649792 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0915 19:22:52.490982  649792 kubeconfig.go:93] found "kubernetes-upgrade-20210915191929-498219" server: "https://192.168.49.2:8443"
	I0915 19:22:52.491582  649792 kapi.go:59] client config for kubernetes-upgrade-20210915191929-498219: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubernetes-upgrade-20210915191929-498219/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/
profiles/kubernetes-upgrade-20210915191929-498219/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1581620), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0915 19:22:52.493107  649792 ssh_runner.go:152] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0915 19:22:52.499305  649792 api_server.go:164] Checking apiserver status ...
	I0915 19:22:52.499389  649792 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0915 19:22:52.521676  649792 ssh_runner.go:152] Run: sudo egrep ^[0-9]+:freezer: /proc/1482/cgroup
	I0915 19:22:52.528734  649792 api_server.go:180] apiserver freezer: "10:freezer:/docker/bebf70a10aa7bb7357cf66bf378ba92ee0e7b84b34177eb2d40f2b0adf385cc4/kubepods/burstable/pod993488a724f365272c92aef5f4892e6e/a80fd0150bc9a3fd0c4a181d12abdf5e8ab32b72ee3d0a3c8494cc6851301b28"
	I0915 19:22:52.528778  649792 ssh_runner.go:152] Run: sudo cat /sys/fs/cgroup/freezer/docker/bebf70a10aa7bb7357cf66bf378ba92ee0e7b84b34177eb2d40f2b0adf385cc4/kubepods/burstable/pod993488a724f365272c92aef5f4892e6e/a80fd0150bc9a3fd0c4a181d12abdf5e8ab32b72ee3d0a3c8494cc6851301b28/freezer.state
	I0915 19:22:52.534939  649792 api_server.go:202] freezer state: "THAWED"
	I0915 19:22:52.534967  649792 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0915 19:22:52.539758  649792 api_server.go:265] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0915 19:22:52.554276  649792 system_pods.go:86] 8 kube-system pods found
	I0915 19:22:52.554302  649792 system_pods.go:89] "coredns-78fcd69978-dkbpl" [22ed48aa-dcad-4573-9e14-e55f056f63f2] Running
	I0915 19:22:52.554310  649792 system_pods.go:89] "etcd-kubernetes-upgrade-20210915191929-498219" [e4947aa0-9502-4bc1-b578-49d190a58320] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0915 19:22:52.554314  649792 system_pods.go:89] "kindnet-dwt9k" [f26e50eb-1659-11ec-84b6-024286fc7576] Running
	I0915 19:22:52.554327  649792 system_pods.go:89] "kube-apiserver-kubernetes-upgrade-20210915191929-498219" [554f5dba-14f7-4153-a2a3-57259e26aff3] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0915 19:22:52.554335  649792 system_pods.go:89] "kube-controller-manager-kubernetes-upgrade-20210915191929-498219" [31629a58-001f-4720-8b99-eab5daefc587] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0915 19:22:52.554340  649792 system_pods.go:89] "kube-proxy-b5jfk" [6d850bd3-3da2-4859-ae8e-ae44340d2f4f] Running
	I0915 19:22:52.554348  649792 system_pods.go:89] "kube-scheduler-kubernetes-upgrade-20210915191929-498219" [aa9f390a-5f2b-4e73-9f17-bfb72f1f8236] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0915 19:22:52.554353  649792 system_pods.go:89] "storage-provisioner" [e6d9c474-1659-11ec-84b6-024286fc7576] Running
	I0915 19:22:52.555274  649792 api_server.go:139] control plane version: v1.22.2-rc.0
	I0915 19:22:52.555296  649792 kubeadm.go:594] The running cluster does not require reconfiguration: 192.168.49.2
	I0915 19:22:52.555305  649792 kubeadm.go:647] Taking a shortcut, as the cluster seems to be properly configured
	I0915 19:22:52.555311  649792 kubeadm.go:604] restartCluster took 71.57031ms
	I0915 19:22:52.555346  649792 kubeadm.go:392] StartCluster complete in 164.238028ms
	I0915 19:22:52.555365  649792 settings.go:142] acquiring lock: {Name:mk259ca65137eb22f1eac8c1812f7da06160f392 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0915 19:22:52.555452  649792 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	I0915 19:22:52.556493  649792 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig: {Name:mkd61015e23f8ba8a145a0ee59bfc35c5726ad3f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0915 19:22:52.557387  649792 kapi.go:59] client config for kubernetes-upgrade-20210915191929-498219: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubernetes-upgrade-20210915191929-498219/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/
profiles/kubernetes-upgrade-20210915191929-498219/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1581620), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0915 19:22:52.560819  649792 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "kubernetes-upgrade-20210915191929-498219" rescaled to 1
	I0915 19:22:52.560875  649792 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.22.2-rc.0 ControlPlane:true Worker:true}
	I0915 19:22:52.560891  649792 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.2-rc.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0915 19:22:52.563008  649792 out.go:177] * Verifying Kubernetes components...
	I0915 19:22:52.560988  649792 addons.go:404] enableAddons start: toEnable=map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false], additional=[]
	I0915 19:22:52.561089  649792 config.go:177] Loaded profile config "kubernetes-upgrade-20210915191929-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.2-rc.0
	I0915 19:22:52.563076  649792 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
	I0915 19:22:52.563108  649792 addons.go:65] Setting storage-provisioner=true in profile "kubernetes-upgrade-20210915191929-498219"
	I0915 19:22:52.563117  649792 addons.go:65] Setting default-storageclass=true in profile "kubernetes-upgrade-20210915191929-498219"
	I0915 19:22:52.563129  649792 addons.go:153] Setting addon storage-provisioner=true in "kubernetes-upgrade-20210915191929-498219"
	I0915 19:22:52.563137  649792 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "kubernetes-upgrade-20210915191929-498219"
	W0915 19:22:52.563139  649792 addons.go:165] addon storage-provisioner should already be in state true
	I0915 19:22:52.563165  649792 host.go:66] Checking if "kubernetes-upgrade-20210915191929-498219" exists ...
	I0915 19:22:52.563528  649792 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20210915191929-498219 --format={{.State.Status}}
	I0915 19:22:52.563720  649792 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20210915191929-498219 --format={{.State.Status}}
	I0915 19:22:52.611853  649792 kapi.go:59] client config for kubernetes-upgrade-20210915191929-498219: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubernetes-upgrade-20210915191929-498219/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/
profiles/kubernetes-upgrade-20210915191929-498219/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1581620), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0915 19:22:52.620803  649792 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0915 19:22:52.620902  649792 addons.go:337] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0915 19:22:52.620914  649792 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0915 19:22:52.620954  649792 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20210915191929-498219
	I0915 19:22:52.622928  649792 addons.go:153] Setting addon default-storageclass=true in "kubernetes-upgrade-20210915191929-498219"
	W0915 19:22:52.622948  649792 addons.go:165] addon default-storageclass should already be in state true
	I0915 19:22:52.622971  649792 host.go:66] Checking if "kubernetes-upgrade-20210915191929-498219" exists ...
	I0915 19:22:52.623291  649792 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20210915191929-498219 --format={{.State.Status}}
	I0915 19:22:52.629402  649792 api_server.go:50] waiting for apiserver process to appear ...
	I0915 19:22:52.629413  649792 start.go:709] CoreDNS already contains "host.minikube.internal" host record, skipping...
	I0915 19:22:52.629443  649792 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0915 19:22:52.654564  649792 api_server.go:70] duration metric: took 93.643508ms to wait for apiserver process to appear ...
	I0915 19:22:52.654593  649792 api_server.go:86] waiting for apiserver healthz status ...
	I0915 19:22:52.654604  649792 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0915 19:22:52.660168  649792 api_server.go:265] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0915 19:22:52.661137  649792 api_server.go:139] control plane version: v1.22.2-rc.0
	I0915 19:22:52.661158  649792 api_server.go:129] duration metric: took 6.558513ms to wait for apiserver health ...
	I0915 19:22:52.661167  649792 system_pods.go:43] waiting for kube-system pods to appear ...
	I0915 19:22:52.666059  649792 system_pods.go:59] 8 kube-system pods found
	I0915 19:22:52.666086  649792 system_pods.go:61] "coredns-78fcd69978-dkbpl" [22ed48aa-dcad-4573-9e14-e55f056f63f2] Running
	I0915 19:22:52.666096  649792 system_pods.go:61] "etcd-kubernetes-upgrade-20210915191929-498219" [e4947aa0-9502-4bc1-b578-49d190a58320] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0915 19:22:52.666101  649792 system_pods.go:61] "kindnet-dwt9k" [f26e50eb-1659-11ec-84b6-024286fc7576] Running
	I0915 19:22:52.666109  649792 system_pods.go:61] "kube-apiserver-kubernetes-upgrade-20210915191929-498219" [554f5dba-14f7-4153-a2a3-57259e26aff3] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0915 19:22:52.666117  649792 system_pods.go:61] "kube-controller-manager-kubernetes-upgrade-20210915191929-498219" [31629a58-001f-4720-8b99-eab5daefc587] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0915 19:22:52.666126  649792 system_pods.go:61] "kube-proxy-b5jfk" [6d850bd3-3da2-4859-ae8e-ae44340d2f4f] Running
	I0915 19:22:52.666131  649792 system_pods.go:61] "kube-scheduler-kubernetes-upgrade-20210915191929-498219" [aa9f390a-5f2b-4e73-9f17-bfb72f1f8236] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0915 19:22:52.666136  649792 system_pods.go:61] "storage-provisioner" [e6d9c474-1659-11ec-84b6-024286fc7576] Running
	I0915 19:22:52.666140  649792 system_pods.go:74] duration metric: took 4.969448ms to wait for pod list to return data ...
	I0915 19:22:52.666148  649792 kubeadm.go:547] duration metric: took 105.248768ms to wait for : map[apiserver:true system_pods:true] ...
	I0915 19:22:52.666163  649792 node_conditions.go:102] verifying NodePressure condition ...
	I0915 19:22:52.668909  649792 node_conditions.go:122] node storage ephemeral capacity is 309568300Ki
	I0915 19:22:52.668932  649792 node_conditions.go:123] node cpu capacity is 8
	I0915 19:22:52.668943  649792 node_conditions.go:105] duration metric: took 2.775993ms to run NodePressure ...
	I0915 19:22:52.668953  649792 start.go:231] waiting for startup goroutines ...
	I0915 19:22:52.669291  649792 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33147 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/kubernetes-upgrade-20210915191929-498219/id_rsa Username:docker}
	I0915 19:22:52.669345  649792 addons.go:337] installing /etc/kubernetes/addons/storageclass.yaml
	I0915 19:22:52.669362  649792 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0915 19:22:52.669413  649792 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20210915191929-498219
	I0915 19:22:52.711220  649792 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33147 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/kubernetes-upgrade-20210915191929-498219/id_rsa Username:docker}
	I0915 19:22:52.769254  649792 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.2-rc.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0915 19:22:52.800462  649792 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.2-rc.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0915 19:22:52.165959  655247 pod_ready.go:92] pod "kube-scheduler-pause-20210915191717-498219" in "kube-system" namespace has status "Ready":"True"
	I0915 19:22:52.165985  655247 pod_ready.go:81] duration metric: took 400.084813ms waiting for pod "kube-scheduler-pause-20210915191717-498219" in "kube-system" namespace to be "Ready" ...
	I0915 19:22:52.165995  655247 pod_ready.go:38] duration metric: took 886.564082ms for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0915 19:22:52.166016  655247 api_server.go:50] waiting for apiserver process to appear ...
	I0915 19:22:52.166063  655247 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0915 19:22:52.189273  655247 api_server.go:70] duration metric: took 1.002128278s to wait for apiserver process to appear ...
	I0915 19:22:52.189301  655247 api_server.go:86] waiting for apiserver healthz status ...
	I0915 19:22:52.189313  655247 api_server.go:239] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0915 19:22:52.197035  655247 api_server.go:265] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0915 19:22:52.197866  655247 api_server.go:139] control plane version: v1.22.1
	I0915 19:22:52.197888  655247 api_server.go:129] duration metric: took 8.578674ms to wait for apiserver health ...
	I0915 19:22:52.197898  655247 system_pods.go:43] waiting for kube-system pods to appear ...
	I0915 19:22:52.369337  655247 system_pods.go:59] 8 kube-system pods found
	I0915 19:22:52.369369  655247 system_pods.go:61] "coredns-78fcd69978-87x4l" [bacedd06-5f04-410d-bb77-6d7082ac74d8] Running
	I0915 19:22:52.369376  655247 system_pods.go:61] "etcd-pause-20210915191717-498219" [0991dada-71a6-43d0-9f66-c9b25809bc2b] Running
	I0915 19:22:52.369382  655247 system_pods.go:61] "kindnet-m5zrb" [b75f582d-6b59-4a29-8f66-5670fc372ef7] Running
	I0915 19:22:52.369388  655247 system_pods.go:61] "kube-apiserver-pause-20210915191717-498219" [b443a356-bad3-43f5-adf0-a707a59b1e3e] Running
	I0915 19:22:52.369395  655247 system_pods.go:61] "kube-controller-manager-pause-20210915191717-498219" [80b9f270-d952-46f1-aaf8-fd7809c43695] Running
	I0915 19:22:52.369401  655247 system_pods.go:61] "kube-proxy-x78hq" [78449e93-ea1e-46cd-92ca-d416ecbee251] Running
	I0915 19:22:52.369411  655247 system_pods.go:61] "kube-scheduler-pause-20210915191717-498219" [a833ad01-8882-480d-96e1-2e27e2c74b24] Running
	I0915 19:22:52.369421  655247 system_pods.go:61] "storage-provisioner" [b89fc9f6-92a3-4764-a891-43683f852797] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
	I0915 19:22:52.369431  655247 system_pods.go:74] duration metric: took 171.52699ms to wait for pod list to return data ...
	I0915 19:22:52.369444  655247 default_sa.go:34] waiting for default service account to be created ...
	I0915 19:22:52.565908  655247 default_sa.go:45] found service account: "default"
	I0915 19:22:52.565929  655247 default_sa.go:55] duration metric: took 196.475209ms for default service account to be created ...
	I0915 19:22:52.565939  655247 system_pods.go:116] waiting for k8s-apps to be running ...
	I0915 19:22:52.768687  655247 system_pods.go:86] 8 kube-system pods found
	I0915 19:22:52.768714  655247 system_pods.go:89] "coredns-78fcd69978-87x4l" [bacedd06-5f04-410d-bb77-6d7082ac74d8] Running
	I0915 19:22:52.768720  655247 system_pods.go:89] "etcd-pause-20210915191717-498219" [0991dada-71a6-43d0-9f66-c9b25809bc2b] Running
	I0915 19:22:52.768726  655247 system_pods.go:89] "kindnet-m5zrb" [b75f582d-6b59-4a29-8f66-5670fc372ef7] Running
	I0915 19:22:52.768731  655247 system_pods.go:89] "kube-apiserver-pause-20210915191717-498219" [b443a356-bad3-43f5-adf0-a707a59b1e3e] Running
	I0915 19:22:52.768738  655247 system_pods.go:89] "kube-controller-manager-pause-20210915191717-498219" [80b9f270-d952-46f1-aaf8-fd7809c43695] Running
	I0915 19:22:52.768743  655247 system_pods.go:89] "kube-proxy-x78hq" [78449e93-ea1e-46cd-92ca-d416ecbee251] Running
	I0915 19:22:52.768749  655247 system_pods.go:89] "kube-scheduler-pause-20210915191717-498219" [a833ad01-8882-480d-96e1-2e27e2c74b24] Running
	I0915 19:22:52.768758  655247 system_pods.go:89] "storage-provisioner" [b89fc9f6-92a3-4764-a891-43683f852797] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
	I0915 19:22:52.768771  655247 system_pods.go:126] duration metric: took 202.825735ms to wait for k8s-apps to be running ...
	I0915 19:22:52.768785  655247 system_svc.go:44] waiting for kubelet service to be running ....
	I0915 19:22:52.768826  655247 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
	I0915 19:22:52.778588  655247 system_svc.go:56] duration metric: took 9.793151ms WaitForService to wait for kubelet.
	I0915 19:22:52.778616  655247 kubeadm.go:547] duration metric: took 1.591478015s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0915 19:22:52.778643  655247 node_conditions.go:102] verifying NodePressure condition ...
	I0915 19:22:52.966567  655247 node_conditions.go:122] node storage ephemeral capacity is 309568300Ki
	I0915 19:22:52.966594  655247 node_conditions.go:123] node cpu capacity is 8
	I0915 19:22:52.966612  655247 node_conditions.go:105] duration metric: took 187.960007ms to run NodePressure ...
	I0915 19:22:52.966626  655247 start.go:231] waiting for startup goroutines ...
	I0915 19:22:53.013359  655247 start.go:462] kubectl: 1.20.5, cluster: 1.22.1 (minor skew: 2)
	I0915 19:22:52.967067  649792 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0915 19:22:52.967111  649792 addons.go:406] enableAddons completed in 406.118415ms
	I0915 19:22:53.013805  649792 start.go:462] kubectl: 1.20.5, cluster: 1.22.2-rc.0 (minor skew: 2)
	I0915 19:22:53.015169  649792 out.go:177] 
	W0915 19:22:53.015352  649792 out.go:242] ! /usr/local/bin/kubectl is version 1.20.5, which may have incompatibilites with Kubernetes 1.22.2-rc.0.
	I0915 19:22:53.015171  655247 out.go:177] 
	W0915 19:22:53.015408  655247 out.go:242] ! /usr/local/bin/kubectl is version 1.20.5, which may have incompatibilites with Kubernetes 1.22.1.
	I0915 19:22:53.016953  649792 out.go:177]   - Want kubectl v1.22.2-rc.0? Try 'minikube kubectl -- get pods -A'
	I0915 19:22:53.016949  655247 out.go:177]   - Want kubectl v1.22.1? Try 'minikube kubectl -- get pods -A'
	I0915 19:22:53.018422  655247 out.go:177] * Done! kubectl is now configured to use "pause-20210915191717-498219" cluster and "default" namespace by default
	I0915 19:22:53.018438  649792 out.go:177] * Done! kubectl is now configured to use "kubernetes-upgrade-20210915191929-498219" cluster and "default" namespace by default
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID
	8a0ee0c424319       6e38f40d628db       12 seconds ago       Running             storage-provisioner       0                   f553a8f9f4bdb
	4e3e2ce59d5c1       8d147537fb7d1       44 seconds ago       Running             coredns                   0                   7ea0d242ee6d7
	add40aaf7d1e1       6de166512aa22       About a minute ago   Running             kindnet-cni               0                   84d365a86ab31
	0f8eb1bcec3c0       36c4ebbc9d979       About a minute ago   Running             kube-proxy                0                   615b93865a245
	ffa7fe563436a       6e002eb89a881       About a minute ago   Running             kube-controller-manager   0                   9801458e1a86a
	f9a6017a48e43       aca5ededae9c8       About a minute ago   Running             kube-scheduler            0                   88a3889c95bb5
	c59a5411d0a43       f30469a2491a5       About a minute ago   Running             kube-apiserver            0                   af1e2cc7dc24b
	68c751171dcd7       0048118155842       About a minute ago   Running             etcd                      0                   d9f651544d709
	
	* 
	* ==> containerd <==
	* -- Logs begin at Wed 2021-09-15 19:20:45 UTC, end at Wed 2021-09-15 19:23:04 UTC. --
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289115815Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289128254Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289138345Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289254269Z" level=warning msg="`default_runtime` is deprecated, please use `default_runtime_name` to reference the default configuration you have defined in `runtimes`"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289308982Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:default DefaultRuntime:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} UntrustedWorkloadRuntime:{Type: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} Runtimes:map[default:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} runc:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:0xc0003e8f60 PrivilegedWithoutHostDevices:false BaseRuntimeSpec:}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:false} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPlugi
nConfDir:/etc/cni/net.mk NetworkPluginMaxConfNum:1 NetworkPluginConfTemplate:} Registry:{Mirrors:map[docker.io:{Endpoints:[https://registry-1.docker.io]}] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:} DisableTCPService:true StreamServerAddress: StreamServerPort:10010 StreamIdleTimeout:4h0m0s EnableSelinux:false SelinuxCategoryRange:1024 SandboxImage:k8s.gcr.io/pause:3.5 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true IgnoreImageDefinedVolumes:false} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289381402Z" level=info msg="Connect containerd service"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289437523Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\""
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290081182Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290147751Z" level=info msg="Start subscribing containerd event"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290222669Z" level=info msg="Start recovering state"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290327818Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290751047Z" level=info msg=serving... address=/run/containerd/containerd.sock
	Sep 15 19:22:39 pause-20210915191717-498219 systemd[1]: Started containerd container runtime.
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.292542658Z" level=info msg="containerd successfully booted in 0.059289s"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373258157Z" level=info msg="Start event monitor"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373302442Z" level=info msg="Start snapshots syncer"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373315590Z" level=info msg="Start cni network conf syncer"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373323115Z" level=info msg="Start streaming server"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.004127018Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:b89fc9f6-92a3-4764-a891-43683f852797,Namespace:kube-system,Attempt:0,}"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.022589782Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406 pid=3354
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.189609846Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:b89fc9f6-92a3-4764-a891-43683f852797,Namespace:kube-system,Attempt:0,} returns sandbox id \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.192476910Z" level=info msg="CreateContainer within sandbox \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.264711641Z" level=info msg="CreateContainer within sandbox \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.265309072Z" level=info msg="StartContainer for \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.426381063Z" level=info msg="StartContainer for \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\" returns successfully"
	
	* 
	* ==> coredns [4e3e2ce59d5c18a575c0fcd0817a37be6f3100ed723ce065f62dde7f1eb0a51c] <==
	* .:53
	[INFO] plugin/reload: Running configuration MD5 = e58989e162233e5f3ebed8edb075da2b
	CoreDNS-1.8.4
	linux/amd64, go1.16.4, 053c4d5
	
	* 
	* ==> describe nodes <==
	* Name:               pause-20210915191717-498219
	Roles:              control-plane,master
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=pause-20210915191717-498219
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=66748304c4ca78061b718f95ac626a53ac360876
	                    minikube.k8s.io/name=pause-20210915191717-498219
	                    minikube.k8s.io/updated_at=2021_09_15T19_21_45_0700
	                    minikube.k8s.io/version=v1.23.0
	                    node-role.kubernetes.io/control-plane=
	                    node-role.kubernetes.io/master=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Wed, 15 Sep 2021 19:21:41 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  pause-20210915191717-498219
	  AcquireTime:     <unset>
	  RenewTime:       Wed, 15 Sep 2021 19:23:01 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:22:15 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.76.2
	  Hostname:    pause-20210915191717-498219
	Capacity:
	  cpu:                8
	  ephemeral-storage:  309568300Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32951368Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  309568300Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32951368Ki
	  pods:               110
	System Info:
	  Machine ID:                 4b5e5cdd53d44f5ab575bb522d42acca
	  System UUID:                6c096439-dfd0-4bf2-9d72-aed11150be6a
	  Boot ID:                    d1f48c72-ac32-4c43-bb38-cbe6179197b8
	  Kernel Version:             4.9.0-16-amd64
	  OS Image:                   Ubuntu 20.04.2 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.4.9
	  Kubelet Version:            v1.22.1
	  Kube-Proxy Version:         v1.22.1
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (8 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  kube-system                 coredns-78fcd69978-87x4l                               100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     67s
	  kube-system                 etcd-pause-20210915191717-498219                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         79s
	  kube-system                 kindnet-m5zrb                                          100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      67s
	  kube-system                 kube-apiserver-pause-20210915191717-498219             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         81s
	  kube-system                 kube-controller-manager-pause-20210915191717-498219    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         79s
	  kube-system                 kube-proxy-x78hq                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         67s
	  kube-system                 kube-scheduler-pause-20210915191717-498219             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         79s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                850m (10%!)(MISSING)  100m (1%!)(MISSING)
	  memory             220Mi (0%!)(MISSING)  220Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From     Message
	  ----    ------                   ----               ----     -------
	  Normal  Starting                 89s                kubelet  Starting kubelet.
	  Normal  NodeHasSufficientMemory  88s (x3 over 88s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    88s (x3 over 88s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     88s (x2 over 88s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  88s                kubelet  Updated Node Allocatable limit across pods
	  Normal  Starting                 80s                kubelet  Starting kubelet.
	  Normal  NodeHasSufficientMemory  79s                kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    79s                kubelet  Node pause-20210915191717-498219 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     79s                kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  79s                kubelet  Updated Node Allocatable limit across pods
	  Normal  NodeReady                49s                kubelet  Node pause-20210915191717-498219 status is now: NodeReady
	
	* 
	* ==> dmesg <==
	* [  +0.000003] ll header: 00000000: ff ff ff ff ff ff 0e cc 37 49 8f cc 08 06        ........7I....
	[Sep15 19:15] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:16] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth7ac412fc
	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 0e 03 57 43 c3 f6 08 06        ........WC....
	[Sep15 19:17] cgroup: cgroup2: unknown option "nsdelegate"
	[ +24.447023] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:19] cgroup: cgroup2: unknown option "nsdelegate"
	[ +29.341499] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:20] cgroup: cgroup2: unknown option "nsdelegate"
	[  +7.752932] cgroup: cgroup2: unknown option "nsdelegate"
	[  +1.168476] cgroup: cgroup2: unknown option "nsdelegate"
	[  +0.883365] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:21] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethc7f59d8a
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff fe 62 09 bc 6e 99 08 06        .......b..n...
	[  +4.026078] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethae8b0a09
	[  +0.000001] ll header: 00000000: ff ff ff ff ff ff 76 c5 05 52 bd 2c 08 06        ......v..R.,..
	[  +2.294384] IPv4: martian source 10.244.0.3 from 10.244.0.3, on dev vethee7d8cc4
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 42 f1 0d a2 67 58 08 06        ......B...gX..
	[Sep15 19:22] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth2dc59167
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 32 6a 0d 06 42 d3 08 06        ......2j..B...
	[  +2.711472] IPv4: martian source 10.244.0.4 from 10.244.0.4, on dev veth4dd80444
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 66 3a 96 9d c7 49 08 06        ......f:...I..
	[ +13.259098] cgroup: cgroup2: unknown option "nsdelegate"
	[  +0.866691] IPv4: martian source 10.244.0.5 from 10.244.0.5, on dev vethbabe3094
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 5e 69 cf 9d 65 c0 08 06        ......^i..e...
	
	* 
	* ==> etcd [68c751171dcd7d647b503ddd8a23729be4c80075be04f4911d2d09c0cd2ef1d6] <==
	* {"level":"warn","ts":"2021-09-15T19:23:02.791Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:01.794Z","time spent":"997.399319ms","remote":"127.0.0.1:38158","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":599,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" mod_revision:524 > success:<request_put:<key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" value_size:531 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" > >"}
	{"level":"info","ts":"2021-09-15T19:23:02.791Z","caller":"traceutil/trace.go:171","msg":"trace[1006913848] linearizableReadLoop","detail":"{readStateIndex:570; appliedIndex:569; }","duration":"2.591966237s","start":"2021-09-15T19:23:00.199Z","end":"2021-09-15T19:23:02.791Z","steps":["trace[1006913848] 'read index received'  (duration: 913.0891ms)","trace[1006913848] 'applied index is now lower than readState.Index'  (duration: 1.678875336s)"],"step_count":2}
	{"level":"warn","ts":"2021-09-15T19:23:02.791Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:22:59.852Z","time spent":"2.939831065s","remote":"127.0.0.1:38060","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1114,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" mod_revision:545 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" value_size:1041 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" > >"}
	{"level":"warn","ts":"2021-09-15T19:23:03.292Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":15638323004940351675,"retry-timeout":"500ms"}
	{"level":"warn","ts":"2021-09-15T19:23:03.792Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":15638323004940351675,"retry-timeout":"500ms"}
	{"level":"warn","ts":"2021-09-15T19:23:03.996Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.056444461s","expected-duration":"1s"}
	{"level":"info","ts":"2021-09-15T19:23:03.996Z","caller":"traceutil/trace.go:171","msg":"trace[994553924] linearizableReadLoop","detail":"{readStateIndex:571; appliedIndex:571; }","duration":"1.204874877s","start":"2021-09-15T19:23:02.791Z","end":"2021-09-15T19:23:03.996Z","steps":["trace[994553924] 'read index received'  (duration: 1.204854238s)","trace[994553924] 'applied index is now lower than readState.Index'  (duration: 18.873µs)"],"step_count":2}
	{"level":"warn","ts":"2021-09-15T19:23:03.997Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.792511814s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085\" ","response":"range_response_count:1 size:787"}
	{"level":"info","ts":"2021-09-15T19:23:03.997Z","caller":"traceutil/trace.go:171","msg":"trace[1998177799] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085; range_end:; response_count:1; response_revision:548; }","duration":"1.792595532s","start":"2021-09-15T19:23:02.205Z","end":"2021-09-15T19:23:03.997Z","steps":["trace[1998177799] 'agreement among raft nodes before linearized reading'  (duration: 1.791882626s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.997Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.204Z","time spent":"1.792678664s","remote":"127.0.0.1:38010","response type":"/etcdserverpb.KV/Range","request count":0,"request size":90,"response count":1,"response size":810,"request content":"key:\"/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.738122175s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[1177029980] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:548; }","duration":"1.738172063s","start":"2021-09-15T19:23:02.259Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[1177029980] 'agreement among raft nodes before linearized reading'  (duration: 1.736912592s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.259Z","time spent":"1.738230286s","remote":"127.0.0.1:38250","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":28,"request content":"key:\"/registry/health\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.493659597s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[2071497708] range","detail":"{range_begin:/registry/networkpolicies/; range_end:/registry/networkpolicies0; response_count:0; response_revision:548; }","duration":"1.493691663s","start":"2021-09-15T19:23:02.504Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[2071497708] 'agreement among raft nodes before linearized reading'  (duration: 1.492292928s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.504Z","time spent":"1.493733527s","remote":"127.0.0.1:38170","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":0,"response size":28,"request content":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.789357774s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"830.565162ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/default\" ","response":"range_response_count:1 size:343"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[1354754751] range","detail":"{range_begin:/registry/namespaces/default; range_end:; response_count:1; response_revision:548; }","duration":"830.609729ms","start":"2021-09-15T19:23:03.167Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[1354754751] 'agreement among raft nodes before linearized reading'  (duration: 828.900071ms)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:03.167Z","time spent":"830.664651ms","remote":"127.0.0.1:38054","response type":"/etcdserverpb.KV/Range","request count":0,"request size":30,"response count":1,"response size":366,"request content":"key:\"/registry/namespaces/default\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.827186779s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" ","response":"range_response_count:1 size:4936"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[554460785] range","detail":"{range_begin:/registry/minions/; range_end:/registry/minions0; response_count:1; response_revision:548; }","duration":"2.827248402s","start":"2021-09-15T19:23:01.171Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[554460785] 'agreement among raft nodes before linearized reading'  (duration: 2.825281977s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:01.171Z","time spent":"2.827299141s","remote":"127.0.0.1:38068","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":1,"response size":4959,"request content":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" "}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[483421495] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:548; }","duration":"1.789408028s","start":"2021-09-15T19:23:02.209Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[483421495] 'agreement among raft nodes before linearized reading'  (duration: 1.787721349s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.209Z","time spent":"1.78980824s","remote":"127.0.0.1:38250","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":28,"request content":"key:\"/registry/health\" "}
	
	* 
	* ==> kernel <==
	*  19:23:04 up  5:05,  0 users,  load average: 9.52, 4.64, 2.39
	Linux pause-20210915191717-498219 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.2 LTS"
	
	* 
	* ==> kube-apiserver [c59a5411d0a433dc24d4b92cbfe6897ccefe0c7791ebb38fa78a538f7451455a] <==
	* Trace[1935315716]: ---"Transaction committed" 2940ms (19:23:02.792)
	Trace[1935315716]: [2.941327631s] [2.941327631s] END
	I0915 19:23:02.792544       1 trace.go:205] Trace[160500084]: "GuaranteedUpdate etcd3" type:*coordination.Lease (15-Sep-2021 19:23:01.793) (total time: 999ms):
	Trace[160500084]: ---"Transaction committed" 998ms (19:23:02.792)
	Trace[160500084]: [999.103304ms] [999.103304ms] END
	I0915 19:23:02.792708       1 trace.go:205] Trace[83543991]: "Update" url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath,user-agent:storage-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:17b9dfd5-5501-45f7-b3cd-14cd9632e7f8,client:192.168.76.2,accept:application/json, */*,protocol:HTTP/2.0 (15-Sep-2021 19:22:59.850) (total time: 2941ms):
	Trace[83543991]: ---"Object stored in database" 2941ms (19:23:02.792)
	Trace[83543991]: [2.941792202s] [2.941792202s] END
	I0915 19:23:02.792810       1 trace.go:205] Trace[461359119]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210915191717-498219,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:3e3d5ee5-e1f3-456b-82ca-ded19898029f,client:192.168.76.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:23:01.793) (total time: 999ms):
	Trace[461359119]: ---"Object stored in database" 999ms (19:23:02.792)
	Trace[461359119]: [999.531575ms] [999.531575ms] END
	I0915 19:23:03.999781       1 trace.go:205] Trace[988981254]: "Get" url:/api/v1/namespaces/default,user-agent:kube-apiserver/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:a108ccf7-c083-4410-8746-c981a95f95e5,client:127.0.0.1,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (15-Sep-2021 19:23:03.167) (total time: 832ms):
	Trace[988981254]: ---"About to write a response" 832ms (19:23:03.999)
	Trace[988981254]: [832.240765ms] [832.240765ms] END
	I0915 19:23:04.000645       1 trace.go:205] Trace[1888490700]: "GuaranteedUpdate etcd3" type:*core.Event (15-Sep-2021 19:23:02.204) (total time: 1796ms):
	Trace[1888490700]: ---"initial value restored" 1794ms (19:23:03.998)
	Trace[1888490700]: [1.796117778s] [1.796117778s] END
	I0915 19:23:04.000797       1 trace.go:205] Trace[257925177]: "Patch" url:/api/v1/namespaces/kube-system/events/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:d6b68a1f-53de-45b4-957d-2071d61dd2f7,client:192.168.76.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:23:02.204) (total time: 1796ms):
	Trace[257925177]: ---"About to apply patch" 1794ms (19:23:03.998)
	Trace[257925177]: [1.796536176s] [1.796536176s] END
	I0915 19:23:04.001586       1 trace.go:205] Trace[607332746]: "List etcd3" key:/minions,resourceVersion:,resourceVersionMatch:,limit:0,continue: (15-Sep-2021 19:23:01.171) (total time: 2830ms):
	Trace[607332746]: [2.830446727s] [2.830446727s] END
	I0915 19:23:04.002006       1 trace.go:205] Trace[557314537]: "List" url:/api/v1/nodes,user-agent:kindnetd/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:daca3847-81a5-42d6-bc90-18e89e76e274,client:192.168.76.2,accept:application/json, */*,protocol:HTTP/2.0 (15-Sep-2021 19:23:01.171) (total time: 2830ms):
	Trace[557314537]: ---"Listing from storage done" 2830ms (19:23:04.001)
	Trace[557314537]: [2.830874436s] [2.830874436s] END
	
	* 
	* ==> kube-controller-manager [ffa7fe563436a7ae8d7cecd36b9ff38df2bcc5435d8942a21f17d65219db5c80] <==
	* I0915 19:21:56.621813       1 shared_informer.go:247] Caches are synced for GC 
	I0915 19:21:56.666633       1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring 
	I0915 19:21:56.737104       1 shared_informer.go:247] Caches are synced for HPA 
	I0915 19:21:56.771555       1 shared_informer.go:247] Caches are synced for TTL after finished 
	I0915 19:21:56.776318       1 shared_informer.go:247] Caches are synced for resource quota 
	I0915 19:21:56.786816       1 shared_informer.go:247] Caches are synced for bootstrap_signer 
	I0915 19:21:56.814494       1 shared_informer.go:247] Caches are synced for cronjob 
	I0915 19:21:56.815608       1 shared_informer.go:247] Caches are synced for job 
	I0915 19:21:56.816836       1 shared_informer.go:247] Caches are synced for resource quota 
	I0915 19:21:56.849367       1 shared_informer.go:247] Caches are synced for crt configmap 
	I0915 19:21:57.069440       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"
	I0915 19:21:57.245086       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0915 19:21:57.258419       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0915 19:21:57.258447       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0915 19:21:57.424897       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-m5zrb"
	I0915 19:21:57.426662       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-x78hq"
	I0915 19:21:57.620526       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-2cj9r"
	I0915 19:21:57.626422       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-87x4l"
	I0915 19:21:57.831742       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"
	I0915 19:21:57.850742       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-2cj9r"
	I0915 19:22:21.597081       1 node_lifecycle_controller.go:1191] Controller detected that some Nodes are Ready. Exiting master disruption mode.
	W0915 19:22:30.529868       1 endpointslice_controller.go:306] Error syncing endpoint slices for service "kube-system/kube-dns", retrying. Error: failed to update kube-dns-bdr96 EndpointSlice for Service kube-system/kube-dns: etcdserver: request timed out
	I0915 19:22:30.529995       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Service" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpointSlices" message="Error updating Endpoint Slices for Service kube-system/kube-dns: failed to update kube-dns-bdr96 EndpointSlice for Service kube-system/kube-dns: etcdserver: request timed out"
	I0915 19:22:30.535845       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint kube-system/kube-dns: etcdserver: request timed out"
	I0915 19:22:31.128758       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint kube-system/kube-dns: Operation cannot be fulfilled on endpoints \"kube-dns\": the object has been modified; please apply your changes to the latest version and try again"
	
	* 
	* ==> kube-proxy [0f8eb1bcec3c031e531b43c748eea2d33912cf7d55db49e7ea71778813c0c49d] <==
	* I0915 19:22:00.149349       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I0915 19:22:00.149412       1 server_others.go:140] Detected node IP 192.168.76.2
	W0915 19:22:00.149443       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy
	I0915 19:22:00.224185       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary
	I0915 19:22:00.224227       1 server_others.go:212] Using iptables Proxier.
	I0915 19:22:00.224243       1 server_others.go:219] creating dualStackProxier for iptables.
	W0915 19:22:00.224268       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
	I0915 19:22:00.224633       1 server.go:649] Version: v1.22.1
	I0915 19:22:00.225573       1 config.go:315] Starting service config controller
	I0915 19:22:00.225594       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0915 19:22:00.225648       1 config.go:224] Starting endpoint slice config controller
	I0915 19:22:00.225654       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	E0915 19:22:00.237347       1 event_broadcaster.go:253] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pause-20210915191717-498219.16a5152c5a0d5dba", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, EventTime:v1.MicroTime{Time:time.Time{wall:0xc048afd60d6ce200, ext:146529520, loc:(*time.Location)(0x2d81340)}}, Series:(*v1.EventSeries)(nil), ReportingController:"kube-proxy", ReportingInstance:"kube-proxy-pause-20210915191717-498219", Action:"StartKubeProxy", Reason:"Starting", Regarding:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"pause
-20210915191717-498219", UID:"pause-20210915191717-498219", APIVersion:"", ResourceVersion:"", FieldPath:""}, Related:(*v1.ObjectReference)(nil), Note:"", Type:"Normal", DeprecatedSource:v1.EventSource{Component:"", Host:""}, DeprecatedFirstTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedLastTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedCount:0}': 'Event "pause-20210915191717-498219.16a5152c5a0d5dba" is invalid: involvedObject.namespace: Invalid value: "": does not match event.namespace' (will not retry!)
	I0915 19:22:00.326477       1 shared_informer.go:247] Caches are synced for service config 
	I0915 19:22:00.326476       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	
	* 
	* ==> kube-scheduler [f9a6017a48e430457074558a4f8587452f4bc9da312b0a267d9b4c66ec6698a3] <==
	* E0915 19:21:41.760210       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0915 19:21:41.760303       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0915 19:21:41.760377       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0915 19:21:41.760448       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0915 19:21:41.761375       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:41.761567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0915 19:21:41.761758       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0915 19:21:41.761874       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0915 19:21:41.762011       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0915 19:21:41.762094       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:41.762150       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0915 19:21:41.762299       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0915 19:21:42.633569       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:42.633572       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:42.656483       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0915 19:21:42.750028       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0915 19:21:42.834567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0915 19:21:42.847835       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0915 19:21:42.905891       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0915 19:21:42.913872       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0915 19:21:44.504439       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.560422       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.562990       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.565584       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	I0915 19:21:45.957351       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Wed 2021-09-15 19:20:45 UTC, end at Wed 2021-09-15 19:23:05 UTC. --
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466612    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/78449e93-ea1e-46cd-92ca-d416ecbee251-xtables-lock\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466634    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-cni-cfg\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466653    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-xtables-lock\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466668    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-lib-modules\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466731    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78449e93-ea1e-46cd-92ca-d416ecbee251-lib-modules\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466791    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wcrs\" (UniqueName: \"kubernetes.io/projected/78449e93-ea1e-46cd-92ca-d416ecbee251-kube-api-access-2wcrs\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466837    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdpn4\" (UniqueName: \"kubernetes.io/projected/b75f582d-6b59-4a29-8f66-5670fc372ef7-kube-api-access-cdpn4\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:22:00 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:00.444629    1889 kubelet.go:2332] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:19.178108    1889 event.go:264] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-pause-20210915191717-498219", UID:"7711ec5bdcd091468467911b3afef6b2", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"Unhealthy", Message:"Readiness
probe failed: HTTP probe failed with statuscode: 500", Source:v1.EventSource{Component:"kubelet", Host:"pause-20210915191717-498219"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc048afd909eda885, ext:27550152024, loc:(*time.Location)(0x55f11597a660)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc048afd909eda885, ext:27550152024, loc:(*time.Location)(0x55f11597a660)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'etcdserver: request timed out' (will not retry!)
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.742011    1889 topology_manager.go:200] "Topology Admit Handler"
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.807643    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bacedd06-5f04-410d-bb77-6d7082ac74d8-config-volume\") pod \"coredns-78fcd69978-87x4l\" (UID: \"bacedd06-5f04-410d-bb77-6d7082ac74d8\") "
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.807946    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrzf5\" (UniqueName: \"kubernetes.io/projected/bacedd06-5f04-410d-bb77-6d7082ac74d8-kube-api-access-mrzf5\") pod \"coredns-78fcd69978-87x4l\" (UID: \"bacedd06-5f04-410d-bb77-6d7082ac74d8\") "
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: W0915 19:22:39.201764    1889 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: W0915 19:22:39.201764    1889 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251093    1889 remote_runtime.go:207] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\"" filter="&PodSandboxFilter{Id:,State:&PodSandboxStateValue{State:SANDBOX_READY,},LabelSelector:map[string]string{},}"
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251148    1889 kuberuntime_sandbox.go:281] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251163    1889 kubelet_pods.go:1117] "Error listing containers" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251179    1889 kubelet.go:2143] "Failed cleaning pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.322958    1889 remote_runtime.go:207] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\"" filter="nil"
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.323017    1889 kuberuntime_sandbox.go:281] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.323041    1889 generic.go:205] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.752088    1889 remote_runtime.go:86] "Version from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.700577    1889 topology_manager.go:200] "Topology Admit Handler"
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.739217    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/b89fc9f6-92a3-4764-a891-43683f852797-tmp\") pod \"storage-provisioner\" (UID: \"b89fc9f6-92a3-4764-a891-43683f852797\") "
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.739305    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnnvv\" (UniqueName: \"kubernetes.io/projected/b89fc9f6-92a3-4764-a891-43683f852797-kube-api-access-mnnvv\") pod \"storage-provisioner\" (UID: \"b89fc9f6-92a3-4764-a891-43683f852797\") "
	
	* 
	* ==> storage-provisioner [8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de] <==
	* I0915 19:22:52.434096       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0915 19:22:52.442402       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0915 19:22:52.442449       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0915 19:22:52.449631       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0915 19:22:52.449779       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554!
	I0915 19:22:52.449737       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"edcec5d9-3929-420f-ac85-43ebcaef7c79", APIVersion:"v1", ResourceVersion:"540", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554 became leader
	I0915 19:22:52.550239       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554!
	

                                                
                                                
-- /stdout --
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20210915191717-498219 -n pause-20210915191717-498219

                                                
                                                
=== CONT  TestPause/serial/Pause
helpers_test.go:262: (dbg) Run:  kubectl --context pause-20210915191717-498219 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:271: non-running pods: 
helpers_test.go:273: ======> post-mortem[TestPause/serial/Pause]: describe non-running pods <======
helpers_test.go:276: (dbg) Run:  kubectl --context pause-20210915191717-498219 describe pod 
helpers_test.go:276: (dbg) Non-zero exit: kubectl --context pause-20210915191717-498219 describe pod : exit status 1 (63.055731ms)

                                                
                                                
** stderr ** 
	error: resource name may not be empty

                                                
                                                
** /stderr **
helpers_test.go:278: kubectl --context pause-20210915191717-498219 describe pod : exit status 1
helpers_test.go:223: -----------------------post-mortem--------------------------------
helpers_test.go:231: ======>  post-mortem[TestPause/serial/Pause]: docker inspect <======
helpers_test.go:232: (dbg) Run:  docker inspect pause-20210915191717-498219
helpers_test.go:236: (dbg) docker inspect pause-20210915191717-498219:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74",
	        "Created": "2021-09-15T19:20:44.739194513Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 639632,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2021-09-15T19:20:45.450816177Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:83b5a81388468b1ffcd3874b4f24c1406c63c33ac07797cc8bed6ad0207d36a8",
	        "ResolvConfPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/hostname",
	        "HostsPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/hosts",
	        "LogPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74-json.log",
	        "Name": "/pause-20210915191717-498219",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "pause-20210915191717-498219:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "pause-20210915191717-498219",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "Capabilities": null,
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 0,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [
	                {
	                    "PathOnHost": "/dev/fuse",
	                    "PathInContainer": "/dev/fuse",
	                    "CgroupPermissions": "rwm"
	                }
	            ],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 0,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e-init/diff:/var/lib/docker/overlay2/0f8a10c746fedd8d666b9dae9bdd481a4ecb3bdc1c19c1763f5067cb6f6ec480/diff:/var/lib/docker/overlay2/f54dd51211f7fd37ed9e7e1b70117531d83c45068e0d908bb274324aaab9559e/diff:/var/lib/docker/overlay2/db8bcdf3259b37def0e8daacd8a4b91582e91b1335c4898bead8f0570ee379f4/diff:/var/lib/docker/overlay2/38faf25fee6b5c923ea643302bba2da4194356f1ecd1442a2371c90afb025b10/diff:/var/lib/docker/overlay2/c4a1a3e49e5edffd417be1158a98868c52bdfc84e62524f2c795e427d987e984/diff:/var/lib/docker/overlay2/e68c2d7fd8912bc6f5e5c4fd63053076de99a4d27b5ac2d087e97b170c724fbd/diff:/var/lib/docker/overlay2/c74734152182eae7a2408058cc612acaac307696039525cbf809638bdc5f0291/diff:/var/lib/docker/overlay2/871cb5ebce097dd4aeeed897eae2f2516c492acd2cf20e22a9bd621400d03fab/diff:/var/lib/docker/overlay2/c6de31e81e924f091a3674cc807ae856aaaf0bd75eede35b8012e555a78482f8/diff:/var/lib/docker/overlay2/5cb89b
dcb371bd4714cf4cc592534e708077fc8ba74ac5611767920d2e72b515/diff:/var/lib/docker/overlay2/855cba59b338da688aa696b251e03ec2f0d9dc95537b26265f31042b64dbcc2d/diff:/var/lib/docker/overlay2/68e4b369a0e1b1a42b5b9874ee9fa0849598643096f78bd2ff9f86e7f0dee281/diff:/var/lib/docker/overlay2/7d9c9be2ec55a3cfaeb8e493bde1f09d3e07500aa41b31d9dc92e3a045bfaa88/diff:/var/lib/docker/overlay2/e229f9da50c177e6addfce418c74667438f518d5821a0f714cb58a3968830c71/diff:/var/lib/docker/overlay2/ef41fa20aaf0f3e8b0f0873abea368bc5dfaf6684783ca409e3d6dfa74ca2b33/diff:/var/lib/docker/overlay2/8160677224d3d0ba75ceac5e22adbe4420f58aa9df575a4fa1eb16cfa5d36cb1/diff:/var/lib/docker/overlay2/747c3fc9ab1ea2616d662bd3b2e2f1ddbdac907a6eea86ac017e9ce3e66dc4d9/diff:/var/lib/docker/overlay2/f8eb124418298912c3691320300767eabaeae37f352f56c2d0e5a40dd97b0bc2/diff:/var/lib/docker/overlay2/c37f4c78c3026a8785fb4aca9fa78dc5ac21307cb3bfbf746bacec078e037770/diff:/var/lib/docker/overlay2/ee71c4960738cdf41b558b5aa16215f18299ecf0b241560a77477f080674ba8c/diff:/var/lib/d
ocker/overlay2/f2132a0cc49a4383ce675ba6870120bd2c58077afad82ab90d066c0651128e1d/diff:/var/lib/docker/overlay2/44200c5ed83b044737127b23b0b15c55e21152acc08ba98910e0dcb93835c4d5/diff:/var/lib/docker/overlay2/22bce5e99989e32cb7a1f876e412e03427623b5cb70e4709d0336c2cae5f4b37/diff:/var/lib/docker/overlay2/ccfb925585c3768c7aba8e731873849181bedce4d441b3095c1abfd310c405e1/diff:/var/lib/docker/overlay2/a90553cf4067ab91ee5ed23daf5f3aab785ded168917688d3c11e7eb856cc869/diff:/var/lib/docker/overlay2/dc493bca572baf2fff7143d6c551dc24acb22082e51a68200466da7510d37550/diff:/var/lib/docker/overlay2/e4fdd0a7dd5c09a7507c2e66bb44972d2db20fd3c58d2191eaa45291e1a47321/diff:/var/lib/docker/overlay2/4badf8f702a906675401fab2bb8327dafc5e0098b8a40e8ae31d3f4337c5539e/diff:/var/lib/docker/overlay2/d7a568f51d57ee1283764757ae3c91db612a7acb01906d88f7321359f27d4dcb/diff:/var/lib/docker/overlay2/123e8c40e6520b691981a6af80c211632618f36cb297ef8a28376985e8b9eddf/diff:/var/lib/docker/overlay2/fcfefbd58c332906200403538c8d881d31cbd97ecd5a2e223b198713731
51469/diff:/var/lib/docker/overlay2/a9e5b72b4ba31d329ac284cad558db42f24197775aaabfd188f2846a0a4ce96d/diff:/var/lib/docker/overlay2/7916e1ed717fc8628e14637400ba911d6e64209e501841613f69224c999b54f8/diff:/var/lib/docker/overlay2/3c121fd6f387f06c1b3a211eb1d7db64ffd333a873146a734de241e936ab5322/diff:/var/lib/docker/overlay2/9958539b4278fcc1c310de22689891aba5f238a94351d3c645b9dacba922241b/diff:/var/lib/docker/overlay2/c6c60f0d02b1e1aad2ea4fa1fb017d98e1ca4602689452dbd721342c0927fc6a/diff:/var/lib/docker/overlay2/e61aabb9eb2161801d4795e4a00f41afd54c504a52aeeef70d49d2a4f47fcd99/diff:/var/lib/docker/overlay2/a69e80d9160e6158cf9f37881d60928bf3221341b1fffe8d2855488233278102/diff:/var/lib/docker/overlay2/f76fd1ba3588d22f5228ab597df7a62e20a79217c1712dbc33e20061e12891c6/diff",
	                "MergedDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/merged",
	                "UpperDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/diff",
	                "WorkDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "pause-20210915191717-498219",
	                "Source": "/var/lib/docker/volumes/pause-20210915191717-498219/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "pause-20210915191717-498219",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "pause-20210915191717-498219",
	                "name.minikube.sigs.k8s.io": "pause-20210915191717-498219",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "27118836b403ba46eaa0c5f84b51105679f32ab8d48b0cf3d1809c92f7eab313",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33158"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33156"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33153"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33155"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33154"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/27118836b403",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "pause-20210915191717-498219": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.76.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "475715a3ea2c"
	                    ],
	                    "NetworkID": "b9847da4d513dbef2974381ee64c2c1cc6dd8d925ac1a45cdcc366eac6d6da5c",
	                    "EndpointID": "fdae2a292c54522fc39bfc656e4fce6fd18fc8d9526f059c210503a13a336d70",
	                    "Gateway": "192.168.76.1",
	                    "IPAddress": "192.168.76.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:4c:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210915191717-498219 -n pause-20210915191717-498219
helpers_test.go:245: <<< TestPause/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:246: ======>  post-mortem[TestPause/serial/Pause]: minikube logs <======
helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20210915191717-498219 logs -n 25
helpers_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p pause-20210915191717-498219 logs -n 25: (1.163533658s)
helpers_test.go:253: TestPause/serial/Pause logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	| Command |                    Args                    |                  Profile                   |  User   | Version |          Start Time           |           End Time            |
	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	| ssh     | -p                                         | test-preload-20210915191317-498219         | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:15:29 UTC | Wed, 15 Sep 2021 19:15:29 UTC |
	|         | test-preload-20210915191317-498219         |                                            |         |         |                               |                               |
	|         | -- sudo crictl image ls                    |                                            |         |         |                               |                               |
	| delete  | -p                                         | test-preload-20210915191317-498219         | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:15:29 UTC | Wed, 15 Sep 2021 19:15:32 UTC |
	|         | test-preload-20210915191317-498219         |                                            |         |         |                               |                               |
	| start   | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:15:32 UTC | Wed, 15 Sep 2021 19:16:17 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	|         | --memory=2048 --driver=docker              |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| stop    | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:18 UTC | Wed, 15 Sep 2021 19:16:18 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	|         | --cancel-scheduled                         |                                            |         |         |                               |                               |
	| stop    | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:31 UTC | Wed, 15 Sep 2021 19:16:56 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	|         | --schedule 5s                              |                                            |         |         |                               |                               |
	| delete  | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:58 UTC | Wed, 15 Sep 2021 19:17:03 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	| delete  | -p                                         | insufficient-storage-20210915191703-498219 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:11 UTC | Wed, 15 Sep 2021 19:17:17 UTC |
	|         | insufficient-storage-20210915191703-498219 |                                            |         |         |                               |                               |
	| delete  | -p                                         | kubenet-20210915191717-498219              | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:17:17 UTC |
	|         | kubenet-20210915191717-498219              |                                            |         |         |                               |                               |
	| delete  | -p                                         | flannel-20210915191717-498219              | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:17:18 UTC |
	|         | flannel-20210915191717-498219              |                                            |         |         |                               |                               |
	| delete  | -p false-20210915191718-498219             | false-20210915191718-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:18 UTC | Wed, 15 Sep 2021 19:17:19 UTC |
	| start   | -p                                         | missing-upgrade-20210915191719-498219      | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:18:43 UTC | Wed, 15 Sep 2021 19:19:26 UTC |
	|         | missing-upgrade-20210915191719-498219      |                                            |         |         |                               |                               |
	|         | --memory=2200 --alsologtostderr            |                                            |         |         |                               |                               |
	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | missing-upgrade-20210915191719-498219      | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:19:26 UTC | Wed, 15 Sep 2021 19:19:29 UTC |
	|         | missing-upgrade-20210915191719-498219      |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:19:29 UTC | Wed, 15 Sep 2021 19:20:14 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.14.0               |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| stop    | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:20:14 UTC | Wed, 15 Sep 2021 19:20:35 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	| start   | -p                                         | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:21:46 UTC |
	|         | force-systemd-env-20210915191717-498219    |                                            |         |         |                               |                               |
	|         | --memory=2048 --alsologtostderr            |                                            |         |         |                               |                               |
	|         | -v=5 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| -p      | force-systemd-env-20210915191717-498219    | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:46 UTC | Wed, 15 Sep 2021 19:21:46 UTC |
	|         | ssh cat /etc/containerd/config.toml        |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:20:35 UTC | Wed, 15 Sep 2021 19:21:48 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.22.2-rc.0          |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:46 UTC | Wed, 15 Sep 2021 19:21:50 UTC |
	|         | force-systemd-env-20210915191717-498219    |                                            |         |         |                               |                               |
	| start   | -p                                         | offline-containerd-20210915191717-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:21:56 UTC |
	|         | offline-containerd-20210915191717-498219   |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --memory=2048       |                                            |         |         |                               |                               |
	|         | --wait=true --driver=docker                |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | offline-containerd-20210915191717-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:56 UTC | Wed, 15 Sep 2021 19:22:01 UTC |
	|         | offline-containerd-20210915191717-498219   |                                            |         |         |                               |                               |
	| start   | -p pause-20210915191717-498219             | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:22:36 UTC |
	|         | --memory=2048                              |                                            |         |         |                               |                               |
	|         | --install-addons=false                     |                                            |         |         |                               |                               |
	|         | --wait=all --driver=docker                 |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| start   | -p pause-20210915191717-498219             | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:22:37 UTC | Wed, 15 Sep 2021 19:22:53 UTC |
	|         | --alsologtostderr                          |                                            |         |         |                               |                               |
	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:48 UTC | Wed, 15 Sep 2021 19:22:53 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.22.2-rc.0          |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| -p      | pause-20210915191717-498219                | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:23:04 UTC | Wed, 15 Sep 2021 19:23:05 UTC |
	|         | logs -n 25                                 |                                            |         |         |                               |                               |
	| delete  | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:22:53 UTC | Wed, 15 Sep 2021 19:23:05 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2021/09/15 19:23:05
	Running on machine: debian-jenkins-agent-1
	Binary: Built with gc go1.17 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0915 19:23:05.449127  660452 out.go:298] Setting OutFile to fd 1 ...
	I0915 19:23:05.449340  660452 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:23:05.449350  660452 out.go:311] Setting ErrFile to fd 2...
	I0915 19:23:05.449355  660452 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:23:05.449442  660452 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	I0915 19:23:05.449656  660452 out.go:305] Setting JSON to false
	I0915 19:23:05.491655  660452 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-1","uptime":18343,"bootTime":1631715442,"procs":254,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}
	I0915 19:23:05.491756  660452 start.go:121] virtualization: kvm guest
	I0915 19:23:05.493940  660452 out.go:177] * [running-upgrade-20210915192201-498219] minikube v1.23.0 on Debian 9.13 (kvm/amd64)
	I0915 19:23:05.494062  660452 notify.go:169] Checking for updates...
	I0915 19:23:05.495423  660452 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	I0915 19:23:05.496791  660452 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0915 19:23:05.498393  660452 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube
	I0915 19:23:05.499824  660452 out.go:177]   - MINIKUBE_LOCATION=12425
	I0915 19:23:05.500198  660452 config.go:177] Loaded profile config "running-upgrade-20210915192201-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0915 19:23:05.502025  660452 out.go:177] * Kubernetes 1.22.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.22.1
	I0915 19:23:05.502068  660452 driver.go:343] Setting default libvirt URI to qemu:///system
	I0915 19:23:05.554257  660452 docker.go:132] docker version: linux-19.03.15
	I0915 19:23:05.554367  660452 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 19:23:05.652590  660452 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:38 OomKillDisable:true NGoroutines:45 SystemTime:2021-09-15 19:23:05.594517414 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 19:23:05.652668  660452 docker.go:237] overlay module found
	I0915 19:23:05.654938  660452 out.go:177] * Using the docker driver based on existing profile
	I0915 19:23:05.654968  660452 start.go:278] selected driver: docker
	I0915 19:23:05.654977  660452 start.go:751] validating driver "docker" against &{Name:running-upgrade-20210915192201-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:running-upgrade-20210915192201-498219 Namespace:default APIServerName:m
inikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.59.44 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 19:23:05.655088  660452 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
	W0915 19:23:05.655124  660452 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.
	W0915 19:23:05.655145  660452 out.go:242] ! Your cgroup does not allow setting memory.
	I0915 19:23:05.657012  660452 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities
	I0915 19:23:05.658102  660452 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 19:23:05.752294  660452 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:38 OomKillDisable:true NGoroutines:45 SystemTime:2021-09-15 19:23:05.697841859 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	W0915 19:23:05.752423  660452 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.
	W0915 19:23:05.752472  660452 out.go:242] ! Your cgroup does not allow setting memory.
	I0915 19:23:05.754575  660452 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities
	I0915 19:23:05.754660  660452 cni.go:93] Creating CNI manager for ""
	I0915 19:23:05.754681  660452 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet
	I0915 19:23:05.754692  660452 cni.go:217] auto-setting extra-config to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0915 19:23:05.754697  660452 cni.go:222] extra-config set to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0915 19:23:05.754705  660452 start_flags.go:278] config:
	{Name:running-upgrade-20210915192201-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:running-upgrade-20210915192201-498219 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.59.44 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 19:23:05.756392  660452 out.go:177] * Starting control plane node running-upgrade-20210915192201-498219 in cluster running-upgrade-20210915192201-498219
	I0915 19:23:05.756426  660452 cache.go:118] Beginning downloading kic base image for docker with containerd
	I0915 19:23:05.758006  660452 out.go:177] * Pulling base image ...
	I0915 19:23:05.758061  660452 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0915 19:23:05.758156  660452 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 in local docker daemon
	W0915 19:23:05.824950  660452 preload.go:114] https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v12-v1.20.0-containerd-overlay2-amd64.tar.lz4 status code: 404
	I0915 19:23:05.825137  660452 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/running-upgrade-20210915192201-498219/config.json ...
	I0915 19:23:05.825269  660452 cache.go:108] acquiring lock: {Name:mkfe115146740b768ec6799f9f5a7c24756d39d7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:05.825317  660452 cache.go:108] acquiring lock: {Name:mk28cb082f216f4c21bd3b90d25ef653162d6dab Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:05.825327  660452 cache.go:108] acquiring lock: {Name:mk5ba6ef94c8046672458c1fdb3f125a23257453 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:05.825372  660452 cache.go:108] acquiring lock: {Name:mk6c6b73f5fe2a90d4b5b5ffc92b8dd2bae342f5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:05.825374  660452 cache.go:108] acquiring lock: {Name:mk2967db16a353af0ab57d6cbda9cff16f5f8b0a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:05.825413  660452 cache.go:108] acquiring lock: {Name:mkfc3e48871d60643028225795417546f715a1c8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:05.825454  660452 cache.go:108] acquiring lock: {Name:mkad00e032af6092a0a9e84e39b8790cf93d3733 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:05.825281  660452 cache.go:108] acquiring lock: {Name:mk7935b02ac00959d8f3ee4f1aca766cd1bbce45 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:05.825269  660452 cache.go:108] acquiring lock: {Name:mk2a71697e5dcba560d31f9151ab640010767630 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:05.825457  660452 cache.go:108] acquiring lock: {Name:mk4201b31c3ca9c26dcfdee8a7e96acbe2e348dc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:05.825544  660452 cache.go:116] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/pause_3.2 exists
	I0915 19:23:05.825550  660452 cache.go:116] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0 exists
	I0915 19:23:05.825570  660452 cache.go:97] cache image "k8s.gcr.io/pause:3.2" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/pause_3.2" took 250.963µs
	I0915 19:23:05.825590  660452 cache.go:81] save to tar file k8s.gcr.io/pause:3.2 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/pause_3.2 succeeded
	I0915 19:23:05.825570  660452 cache.go:97] cache image "docker.io/kubernetesui/dashboard:v2.1.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0" took 115.858µs
	I0915 19:23:05.825601  660452 cache.go:81] save to tar file docker.io/kubernetesui/dashboard:v2.1.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0 succeeded
	I0915 19:23:05.825562  660452 image.go:135] retrieving image: k8s.gcr.io/kube-scheduler:v1.20.0
	I0915 19:23:05.825582  660452 image.go:135] retrieving image: k8s.gcr.io/kube-apiserver:v1.20.0
	I0915 19:23:05.825623  660452 image.go:135] retrieving image: k8s.gcr.io/coredns:1.7.0
	I0915 19:23:05.825713  660452 image.go:135] retrieving image: k8s.gcr.io/kube-proxy:v1.20.0
	I0915 19:23:05.825836  660452 cache.go:116] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0915 19:23:05.825838  660452 image.go:135] retrieving image: k8s.gcr.io/kube-controller-manager:v1.20.0
	I0915 19:23:05.825857  660452 cache.go:97] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5" took 406.211µs
	I0915 19:23:05.825866  660452 image.go:135] retrieving image: k8s.gcr.io/etcd:3.4.13-0
	I0915 19:23:05.825870  660452 cache.go:81] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0915 19:23:05.825938  660452 cache.go:116] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4 exists
	I0915 19:23:05.825976  660452 cache.go:97] cache image "docker.io/kubernetesui/metrics-scraper:v1.0.4" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4" took 700.369µs
	I0915 19:23:05.825988  660452 cache.go:81] save to tar file docker.io/kubernetesui/metrics-scraper:v1.0.4 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4 succeeded
	I0915 19:23:05.827029  660452 image.go:181] daemon lookup for k8s.gcr.io/kube-apiserver:v1.20.0: Error response from daemon: reference does not exist
	I0915 19:23:05.827030  660452 image.go:181] daemon lookup for k8s.gcr.io/kube-proxy:v1.20.0: Error response from daemon: reference does not exist
	I0915 19:23:05.827163  660452 image.go:181] daemon lookup for k8s.gcr.io/kube-scheduler:v1.20.0: Error response from daemon: reference does not exist
	I0915 19:23:05.827476  660452 image.go:181] daemon lookup for k8s.gcr.io/kube-controller-manager:v1.20.0: Error response from daemon: reference does not exist
	I0915 19:23:05.881505  660452 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 in local docker daemon, skipping pull
	I0915 19:23:05.881538  660452 cache.go:140] gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 exists in daemon, skipping load
	I0915 19:23:05.881557  660452 cache.go:206] Successfully downloaded all kic artifacts
	I0915 19:23:05.881601  660452 start.go:313] acquiring machines lock for running-upgrade-20210915192201-498219: {Name:mke76eb0c34dba785e2a4639876b4c73e1a9dc89 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:05.881716  660452 start.go:317] acquired machines lock for "running-upgrade-20210915192201-498219" in 87.392µs
	I0915 19:23:05.881742  660452 start.go:93] Skipping create...Using existing machine configuration
	I0915 19:23:05.881750  660452 fix.go:55] fixHost starting: 
	I0915 19:23:05.882021  660452 cli_runner.go:115] Run: docker container inspect running-upgrade-20210915192201-498219 --format={{.State.Status}}
	I0915 19:23:05.932820  660452 fix.go:108] recreateIfNeeded on running-upgrade-20210915192201-498219: state=Running err=<nil>
	W0915 19:23:05.932963  660452 fix.go:134] unexpected machine state, will restart: <nil>
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID
	8a0ee0c424319       6e38f40d628db       14 seconds ago       Running             storage-provisioner       0                   f553a8f9f4bdb
	4e3e2ce59d5c1       8d147537fb7d1       46 seconds ago       Running             coredns                   0                   7ea0d242ee6d7
	add40aaf7d1e1       6de166512aa22       About a minute ago   Running             kindnet-cni               0                   84d365a86ab31
	0f8eb1bcec3c0       36c4ebbc9d979       About a minute ago   Running             kube-proxy                0                   615b93865a245
	ffa7fe563436a       6e002eb89a881       About a minute ago   Running             kube-controller-manager   0                   9801458e1a86a
	f9a6017a48e43       aca5ededae9c8       About a minute ago   Running             kube-scheduler            0                   88a3889c95bb5
	c59a5411d0a43       f30469a2491a5       About a minute ago   Running             kube-apiserver            0                   af1e2cc7dc24b
	68c751171dcd7       0048118155842       About a minute ago   Running             etcd                      0                   d9f651544d709
	
	* 
	* ==> containerd <==
	* -- Logs begin at Wed 2021-09-15 19:20:45 UTC, end at Wed 2021-09-15 19:23:07 UTC. --
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289115815Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289128254Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289138345Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289254269Z" level=warning msg="`default_runtime` is deprecated, please use `default_runtime_name` to reference the default configuration you have defined in `runtimes`"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289308982Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:default DefaultRuntime:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} UntrustedWorkloadRuntime:{Type: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} Runtimes:map[default:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} runc:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:0xc0003e8f60 PrivilegedWithoutHostDevices:false BaseRuntimeSpec:}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:false} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPlugi
nConfDir:/etc/cni/net.mk NetworkPluginMaxConfNum:1 NetworkPluginConfTemplate:} Registry:{Mirrors:map[docker.io:{Endpoints:[https://registry-1.docker.io]}] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:} DisableTCPService:true StreamServerAddress: StreamServerPort:10010 StreamIdleTimeout:4h0m0s EnableSelinux:false SelinuxCategoryRange:1024 SandboxImage:k8s.gcr.io/pause:3.5 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true IgnoreImageDefinedVolumes:false} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289381402Z" level=info msg="Connect containerd service"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289437523Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\""
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290081182Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290147751Z" level=info msg="Start subscribing containerd event"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290222669Z" level=info msg="Start recovering state"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290327818Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290751047Z" level=info msg=serving... address=/run/containerd/containerd.sock
	Sep 15 19:22:39 pause-20210915191717-498219 systemd[1]: Started containerd container runtime.
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.292542658Z" level=info msg="containerd successfully booted in 0.059289s"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373258157Z" level=info msg="Start event monitor"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373302442Z" level=info msg="Start snapshots syncer"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373315590Z" level=info msg="Start cni network conf syncer"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373323115Z" level=info msg="Start streaming server"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.004127018Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:b89fc9f6-92a3-4764-a891-43683f852797,Namespace:kube-system,Attempt:0,}"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.022589782Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406 pid=3354
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.189609846Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:b89fc9f6-92a3-4764-a891-43683f852797,Namespace:kube-system,Attempt:0,} returns sandbox id \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.192476910Z" level=info msg="CreateContainer within sandbox \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.264711641Z" level=info msg="CreateContainer within sandbox \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.265309072Z" level=info msg="StartContainer for \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.426381063Z" level=info msg="StartContainer for \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\" returns successfully"
	
	* 
	* ==> coredns [4e3e2ce59d5c18a575c0fcd0817a37be6f3100ed723ce065f62dde7f1eb0a51c] <==
	* .:53
	[INFO] plugin/reload: Running configuration MD5 = e58989e162233e5f3ebed8edb075da2b
	CoreDNS-1.8.4
	linux/amd64, go1.16.4, 053c4d5
	
	* 
	* ==> describe nodes <==
	* Name:               pause-20210915191717-498219
	Roles:              control-plane,master
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=pause-20210915191717-498219
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=66748304c4ca78061b718f95ac626a53ac360876
	                    minikube.k8s.io/name=pause-20210915191717-498219
	                    minikube.k8s.io/updated_at=2021_09_15T19_21_45_0700
	                    minikube.k8s.io/version=v1.23.0
	                    node-role.kubernetes.io/control-plane=
	                    node-role.kubernetes.io/master=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Wed, 15 Sep 2021 19:21:41 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  pause-20210915191717-498219
	  AcquireTime:     <unset>
	  RenewTime:       Wed, 15 Sep 2021 19:23:01 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:22:15 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.76.2
	  Hostname:    pause-20210915191717-498219
	Capacity:
	  cpu:                8
	  ephemeral-storage:  309568300Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32951368Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  309568300Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32951368Ki
	  pods:               110
	System Info:
	  Machine ID:                 4b5e5cdd53d44f5ab575bb522d42acca
	  System UUID:                6c096439-dfd0-4bf2-9d72-aed11150be6a
	  Boot ID:                    d1f48c72-ac32-4c43-bb38-cbe6179197b8
	  Kernel Version:             4.9.0-16-amd64
	  OS Image:                   Ubuntu 20.04.2 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.4.9
	  Kubelet Version:            v1.22.1
	  Kube-Proxy Version:         v1.22.1
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (8 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  kube-system                 coredns-78fcd69978-87x4l                               100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     70s
	  kube-system                 etcd-pause-20210915191717-498219                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         82s
	  kube-system                 kindnet-m5zrb                                          100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      70s
	  kube-system                 kube-apiserver-pause-20210915191717-498219             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         84s
	  kube-system                 kube-controller-manager-pause-20210915191717-498219    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         82s
	  kube-system                 kube-proxy-x78hq                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         70s
	  kube-system                 kube-scheduler-pause-20210915191717-498219             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         82s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         16s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                850m (10%!)(MISSING)  100m (1%!)(MISSING)
	  memory             220Mi (0%!)(MISSING)  220Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From     Message
	  ----    ------                   ----               ----     -------
	  Normal  Starting                 92s                kubelet  Starting kubelet.
	  Normal  NodeHasSufficientMemory  91s (x3 over 91s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    91s (x3 over 91s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     91s (x2 over 91s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  91s                kubelet  Updated Node Allocatable limit across pods
	  Normal  Starting                 83s                kubelet  Starting kubelet.
	  Normal  NodeHasSufficientMemory  82s                kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    82s                kubelet  Node pause-20210915191717-498219 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     82s                kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  82s                kubelet  Updated Node Allocatable limit across pods
	  Normal  NodeReady                52s                kubelet  Node pause-20210915191717-498219 status is now: NodeReady
	
	* 
	* ==> dmesg <==
	* [  +0.000003] ll header: 00000000: ff ff ff ff ff ff 0e cc 37 49 8f cc 08 06        ........7I....
	[Sep15 19:15] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:16] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth7ac412fc
	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 0e 03 57 43 c3 f6 08 06        ........WC....
	[Sep15 19:17] cgroup: cgroup2: unknown option "nsdelegate"
	[ +24.447023] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:19] cgroup: cgroup2: unknown option "nsdelegate"
	[ +29.341499] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:20] cgroup: cgroup2: unknown option "nsdelegate"
	[  +7.752932] cgroup: cgroup2: unknown option "nsdelegate"
	[  +1.168476] cgroup: cgroup2: unknown option "nsdelegate"
	[  +0.883365] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:21] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethc7f59d8a
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff fe 62 09 bc 6e 99 08 06        .......b..n...
	[  +4.026078] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethae8b0a09
	[  +0.000001] ll header: 00000000: ff ff ff ff ff ff 76 c5 05 52 bd 2c 08 06        ......v..R.,..
	[  +2.294384] IPv4: martian source 10.244.0.3 from 10.244.0.3, on dev vethee7d8cc4
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 42 f1 0d a2 67 58 08 06        ......B...gX..
	[Sep15 19:22] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth2dc59167
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 32 6a 0d 06 42 d3 08 06        ......2j..B...
	[  +2.711472] IPv4: martian source 10.244.0.4 from 10.244.0.4, on dev veth4dd80444
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 66 3a 96 9d c7 49 08 06        ......f:...I..
	[ +13.259098] cgroup: cgroup2: unknown option "nsdelegate"
	[  +0.866691] IPv4: martian source 10.244.0.5 from 10.244.0.5, on dev vethbabe3094
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 5e 69 cf 9d 65 c0 08 06        ......^i..e...
	
	* 
	* ==> etcd [68c751171dcd7d647b503ddd8a23729be4c80075be04f4911d2d09c0cd2ef1d6] <==
	* {"level":"warn","ts":"2021-09-15T19:23:02.791Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:01.794Z","time spent":"997.399319ms","remote":"127.0.0.1:38158","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":599,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" mod_revision:524 > success:<request_put:<key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" value_size:531 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" > >"}
	{"level":"info","ts":"2021-09-15T19:23:02.791Z","caller":"traceutil/trace.go:171","msg":"trace[1006913848] linearizableReadLoop","detail":"{readStateIndex:570; appliedIndex:569; }","duration":"2.591966237s","start":"2021-09-15T19:23:00.199Z","end":"2021-09-15T19:23:02.791Z","steps":["trace[1006913848] 'read index received'  (duration: 913.0891ms)","trace[1006913848] 'applied index is now lower than readState.Index'  (duration: 1.678875336s)"],"step_count":2}
	{"level":"warn","ts":"2021-09-15T19:23:02.791Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:22:59.852Z","time spent":"2.939831065s","remote":"127.0.0.1:38060","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1114,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" mod_revision:545 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" value_size:1041 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" > >"}
	{"level":"warn","ts":"2021-09-15T19:23:03.292Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":15638323004940351675,"retry-timeout":"500ms"}
	{"level":"warn","ts":"2021-09-15T19:23:03.792Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":15638323004940351675,"retry-timeout":"500ms"}
	{"level":"warn","ts":"2021-09-15T19:23:03.996Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.056444461s","expected-duration":"1s"}
	{"level":"info","ts":"2021-09-15T19:23:03.996Z","caller":"traceutil/trace.go:171","msg":"trace[994553924] linearizableReadLoop","detail":"{readStateIndex:571; appliedIndex:571; }","duration":"1.204874877s","start":"2021-09-15T19:23:02.791Z","end":"2021-09-15T19:23:03.996Z","steps":["trace[994553924] 'read index received'  (duration: 1.204854238s)","trace[994553924] 'applied index is now lower than readState.Index'  (duration: 18.873µs)"],"step_count":2}
	{"level":"warn","ts":"2021-09-15T19:23:03.997Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.792511814s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085\" ","response":"range_response_count:1 size:787"}
	{"level":"info","ts":"2021-09-15T19:23:03.997Z","caller":"traceutil/trace.go:171","msg":"trace[1998177799] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085; range_end:; response_count:1; response_revision:548; }","duration":"1.792595532s","start":"2021-09-15T19:23:02.205Z","end":"2021-09-15T19:23:03.997Z","steps":["trace[1998177799] 'agreement among raft nodes before linearized reading'  (duration: 1.791882626s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.997Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.204Z","time spent":"1.792678664s","remote":"127.0.0.1:38010","response type":"/etcdserverpb.KV/Range","request count":0,"request size":90,"response count":1,"response size":810,"request content":"key:\"/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.738122175s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[1177029980] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:548; }","duration":"1.738172063s","start":"2021-09-15T19:23:02.259Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[1177029980] 'agreement among raft nodes before linearized reading'  (duration: 1.736912592s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.259Z","time spent":"1.738230286s","remote":"127.0.0.1:38250","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":28,"request content":"key:\"/registry/health\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.493659597s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[2071497708] range","detail":"{range_begin:/registry/networkpolicies/; range_end:/registry/networkpolicies0; response_count:0; response_revision:548; }","duration":"1.493691663s","start":"2021-09-15T19:23:02.504Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[2071497708] 'agreement among raft nodes before linearized reading'  (duration: 1.492292928s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.504Z","time spent":"1.493733527s","remote":"127.0.0.1:38170","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":0,"response size":28,"request content":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.789357774s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"830.565162ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/default\" ","response":"range_response_count:1 size:343"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[1354754751] range","detail":"{range_begin:/registry/namespaces/default; range_end:; response_count:1; response_revision:548; }","duration":"830.609729ms","start":"2021-09-15T19:23:03.167Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[1354754751] 'agreement among raft nodes before linearized reading'  (duration: 828.900071ms)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:03.167Z","time spent":"830.664651ms","remote":"127.0.0.1:38054","response type":"/etcdserverpb.KV/Range","request count":0,"request size":30,"response count":1,"response size":366,"request content":"key:\"/registry/namespaces/default\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.827186779s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" ","response":"range_response_count:1 size:4936"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[554460785] range","detail":"{range_begin:/registry/minions/; range_end:/registry/minions0; response_count:1; response_revision:548; }","duration":"2.827248402s","start":"2021-09-15T19:23:01.171Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[554460785] 'agreement among raft nodes before linearized reading'  (duration: 2.825281977s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:01.171Z","time spent":"2.827299141s","remote":"127.0.0.1:38068","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":1,"response size":4959,"request content":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" "}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[483421495] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:548; }","duration":"1.789408028s","start":"2021-09-15T19:23:02.209Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[483421495] 'agreement among raft nodes before linearized reading'  (duration: 1.787721349s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.209Z","time spent":"1.78980824s","remote":"127.0.0.1:38250","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":28,"request content":"key:\"/registry/health\" "}
	
	* 
	* ==> kernel <==
	*  19:23:07 up  5:05,  0 users,  load average: 9.52, 4.64, 2.39
	Linux pause-20210915191717-498219 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.2 LTS"
	
	* 
	* ==> kube-apiserver [c59a5411d0a433dc24d4b92cbfe6897ccefe0c7791ebb38fa78a538f7451455a] <==
	* Trace[1935315716]: ---"Transaction committed" 2940ms (19:23:02.792)
	Trace[1935315716]: [2.941327631s] [2.941327631s] END
	I0915 19:23:02.792544       1 trace.go:205] Trace[160500084]: "GuaranteedUpdate etcd3" type:*coordination.Lease (15-Sep-2021 19:23:01.793) (total time: 999ms):
	Trace[160500084]: ---"Transaction committed" 998ms (19:23:02.792)
	Trace[160500084]: [999.103304ms] [999.103304ms] END
	I0915 19:23:02.792708       1 trace.go:205] Trace[83543991]: "Update" url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath,user-agent:storage-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:17b9dfd5-5501-45f7-b3cd-14cd9632e7f8,client:192.168.76.2,accept:application/json, */*,protocol:HTTP/2.0 (15-Sep-2021 19:22:59.850) (total time: 2941ms):
	Trace[83543991]: ---"Object stored in database" 2941ms (19:23:02.792)
	Trace[83543991]: [2.941792202s] [2.941792202s] END
	I0915 19:23:02.792810       1 trace.go:205] Trace[461359119]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210915191717-498219,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:3e3d5ee5-e1f3-456b-82ca-ded19898029f,client:192.168.76.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:23:01.793) (total time: 999ms):
	Trace[461359119]: ---"Object stored in database" 999ms (19:23:02.792)
	Trace[461359119]: [999.531575ms] [999.531575ms] END
	I0915 19:23:03.999781       1 trace.go:205] Trace[988981254]: "Get" url:/api/v1/namespaces/default,user-agent:kube-apiserver/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:a108ccf7-c083-4410-8746-c981a95f95e5,client:127.0.0.1,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (15-Sep-2021 19:23:03.167) (total time: 832ms):
	Trace[988981254]: ---"About to write a response" 832ms (19:23:03.999)
	Trace[988981254]: [832.240765ms] [832.240765ms] END
	I0915 19:23:04.000645       1 trace.go:205] Trace[1888490700]: "GuaranteedUpdate etcd3" type:*core.Event (15-Sep-2021 19:23:02.204) (total time: 1796ms):
	Trace[1888490700]: ---"initial value restored" 1794ms (19:23:03.998)
	Trace[1888490700]: [1.796117778s] [1.796117778s] END
	I0915 19:23:04.000797       1 trace.go:205] Trace[257925177]: "Patch" url:/api/v1/namespaces/kube-system/events/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:d6b68a1f-53de-45b4-957d-2071d61dd2f7,client:192.168.76.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:23:02.204) (total time: 1796ms):
	Trace[257925177]: ---"About to apply patch" 1794ms (19:23:03.998)
	Trace[257925177]: [1.796536176s] [1.796536176s] END
	I0915 19:23:04.001586       1 trace.go:205] Trace[607332746]: "List etcd3" key:/minions,resourceVersion:,resourceVersionMatch:,limit:0,continue: (15-Sep-2021 19:23:01.171) (total time: 2830ms):
	Trace[607332746]: [2.830446727s] [2.830446727s] END
	I0915 19:23:04.002006       1 trace.go:205] Trace[557314537]: "List" url:/api/v1/nodes,user-agent:kindnetd/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:daca3847-81a5-42d6-bc90-18e89e76e274,client:192.168.76.2,accept:application/json, */*,protocol:HTTP/2.0 (15-Sep-2021 19:23:01.171) (total time: 2830ms):
	Trace[557314537]: ---"Listing from storage done" 2830ms (19:23:04.001)
	Trace[557314537]: [2.830874436s] [2.830874436s] END
	
	* 
	* ==> kube-controller-manager [ffa7fe563436a7ae8d7cecd36b9ff38df2bcc5435d8942a21f17d65219db5c80] <==
	* I0915 19:21:56.621813       1 shared_informer.go:247] Caches are synced for GC 
	I0915 19:21:56.666633       1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring 
	I0915 19:21:56.737104       1 shared_informer.go:247] Caches are synced for HPA 
	I0915 19:21:56.771555       1 shared_informer.go:247] Caches are synced for TTL after finished 
	I0915 19:21:56.776318       1 shared_informer.go:247] Caches are synced for resource quota 
	I0915 19:21:56.786816       1 shared_informer.go:247] Caches are synced for bootstrap_signer 
	I0915 19:21:56.814494       1 shared_informer.go:247] Caches are synced for cronjob 
	I0915 19:21:56.815608       1 shared_informer.go:247] Caches are synced for job 
	I0915 19:21:56.816836       1 shared_informer.go:247] Caches are synced for resource quota 
	I0915 19:21:56.849367       1 shared_informer.go:247] Caches are synced for crt configmap 
	I0915 19:21:57.069440       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"
	I0915 19:21:57.245086       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0915 19:21:57.258419       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0915 19:21:57.258447       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0915 19:21:57.424897       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-m5zrb"
	I0915 19:21:57.426662       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-x78hq"
	I0915 19:21:57.620526       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-2cj9r"
	I0915 19:21:57.626422       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-87x4l"
	I0915 19:21:57.831742       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"
	I0915 19:21:57.850742       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-2cj9r"
	I0915 19:22:21.597081       1 node_lifecycle_controller.go:1191] Controller detected that some Nodes are Ready. Exiting master disruption mode.
	W0915 19:22:30.529868       1 endpointslice_controller.go:306] Error syncing endpoint slices for service "kube-system/kube-dns", retrying. Error: failed to update kube-dns-bdr96 EndpointSlice for Service kube-system/kube-dns: etcdserver: request timed out
	I0915 19:22:30.529995       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Service" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpointSlices" message="Error updating Endpoint Slices for Service kube-system/kube-dns: failed to update kube-dns-bdr96 EndpointSlice for Service kube-system/kube-dns: etcdserver: request timed out"
	I0915 19:22:30.535845       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint kube-system/kube-dns: etcdserver: request timed out"
	I0915 19:22:31.128758       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint kube-system/kube-dns: Operation cannot be fulfilled on endpoints \"kube-dns\": the object has been modified; please apply your changes to the latest version and try again"
	
	* 
	* ==> kube-proxy [0f8eb1bcec3c031e531b43c748eea2d33912cf7d55db49e7ea71778813c0c49d] <==
	* I0915 19:22:00.149349       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I0915 19:22:00.149412       1 server_others.go:140] Detected node IP 192.168.76.2
	W0915 19:22:00.149443       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy
	I0915 19:22:00.224185       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary
	I0915 19:22:00.224227       1 server_others.go:212] Using iptables Proxier.
	I0915 19:22:00.224243       1 server_others.go:219] creating dualStackProxier for iptables.
	W0915 19:22:00.224268       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
	I0915 19:22:00.224633       1 server.go:649] Version: v1.22.1
	I0915 19:22:00.225573       1 config.go:315] Starting service config controller
	I0915 19:22:00.225594       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0915 19:22:00.225648       1 config.go:224] Starting endpoint slice config controller
	I0915 19:22:00.225654       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	E0915 19:22:00.237347       1 event_broadcaster.go:253] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pause-20210915191717-498219.16a5152c5a0d5dba", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, EventTime:v1.MicroTime{Time:time.Time{wall:0xc048afd60d6ce200, ext:146529520, loc:(*time.Location)(0x2d81340)}}, Series:(*v1.EventSeries)(nil), ReportingController:"kube-proxy", ReportingInstance:"kube-proxy-pause-20210915191717-498219", Action:"StartKubeProxy", Reason:"Starting", Regarding:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"pause
-20210915191717-498219", UID:"pause-20210915191717-498219", APIVersion:"", ResourceVersion:"", FieldPath:""}, Related:(*v1.ObjectReference)(nil), Note:"", Type:"Normal", DeprecatedSource:v1.EventSource{Component:"", Host:""}, DeprecatedFirstTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedLastTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedCount:0}': 'Event "pause-20210915191717-498219.16a5152c5a0d5dba" is invalid: involvedObject.namespace: Invalid value: "": does not match event.namespace' (will not retry!)
	I0915 19:22:00.326477       1 shared_informer.go:247] Caches are synced for service config 
	I0915 19:22:00.326476       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	
	* 
	* ==> kube-scheduler [f9a6017a48e430457074558a4f8587452f4bc9da312b0a267d9b4c66ec6698a3] <==
	* E0915 19:21:41.760210       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0915 19:21:41.760303       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0915 19:21:41.760377       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0915 19:21:41.760448       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0915 19:21:41.761375       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:41.761567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0915 19:21:41.761758       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0915 19:21:41.761874       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0915 19:21:41.762011       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0915 19:21:41.762094       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:41.762150       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0915 19:21:41.762299       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0915 19:21:42.633569       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:42.633572       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:42.656483       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0915 19:21:42.750028       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0915 19:21:42.834567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0915 19:21:42.847835       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0915 19:21:42.905891       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0915 19:21:42.913872       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0915 19:21:44.504439       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.560422       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.562990       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.565584       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	I0915 19:21:45.957351       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Wed 2021-09-15 19:20:45 UTC, end at Wed 2021-09-15 19:23:07 UTC. --
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466612    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/78449e93-ea1e-46cd-92ca-d416ecbee251-xtables-lock\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466634    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-cni-cfg\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466653    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-xtables-lock\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466668    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-lib-modules\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466731    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78449e93-ea1e-46cd-92ca-d416ecbee251-lib-modules\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466791    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wcrs\" (UniqueName: \"kubernetes.io/projected/78449e93-ea1e-46cd-92ca-d416ecbee251-kube-api-access-2wcrs\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466837    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdpn4\" (UniqueName: \"kubernetes.io/projected/b75f582d-6b59-4a29-8f66-5670fc372ef7-kube-api-access-cdpn4\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:22:00 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:00.444629    1889 kubelet.go:2332] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:19.178108    1889 event.go:264] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-pause-20210915191717-498219", UID:"7711ec5bdcd091468467911b3afef6b2", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"Unhealthy", Message:"Readiness
probe failed: HTTP probe failed with statuscode: 500", Source:v1.EventSource{Component:"kubelet", Host:"pause-20210915191717-498219"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc048afd909eda885, ext:27550152024, loc:(*time.Location)(0x55f11597a660)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc048afd909eda885, ext:27550152024, loc:(*time.Location)(0x55f11597a660)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'etcdserver: request timed out' (will not retry!)
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.742011    1889 topology_manager.go:200] "Topology Admit Handler"
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.807643    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bacedd06-5f04-410d-bb77-6d7082ac74d8-config-volume\") pod \"coredns-78fcd69978-87x4l\" (UID: \"bacedd06-5f04-410d-bb77-6d7082ac74d8\") "
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.807946    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrzf5\" (UniqueName: \"kubernetes.io/projected/bacedd06-5f04-410d-bb77-6d7082ac74d8-kube-api-access-mrzf5\") pod \"coredns-78fcd69978-87x4l\" (UID: \"bacedd06-5f04-410d-bb77-6d7082ac74d8\") "
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: W0915 19:22:39.201764    1889 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: W0915 19:22:39.201764    1889 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251093    1889 remote_runtime.go:207] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\"" filter="&PodSandboxFilter{Id:,State:&PodSandboxStateValue{State:SANDBOX_READY,},LabelSelector:map[string]string{},}"
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251148    1889 kuberuntime_sandbox.go:281] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251163    1889 kubelet_pods.go:1117] "Error listing containers" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251179    1889 kubelet.go:2143] "Failed cleaning pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.322958    1889 remote_runtime.go:207] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\"" filter="nil"
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.323017    1889 kuberuntime_sandbox.go:281] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.323041    1889 generic.go:205] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.752088    1889 remote_runtime.go:86] "Version from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.700577    1889 topology_manager.go:200] "Topology Admit Handler"
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.739217    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/b89fc9f6-92a3-4764-a891-43683f852797-tmp\") pod \"storage-provisioner\" (UID: \"b89fc9f6-92a3-4764-a891-43683f852797\") "
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.739305    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnnvv\" (UniqueName: \"kubernetes.io/projected/b89fc9f6-92a3-4764-a891-43683f852797-kube-api-access-mnnvv\") pod \"storage-provisioner\" (UID: \"b89fc9f6-92a3-4764-a891-43683f852797\") "
	
	* 
	* ==> storage-provisioner [8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de] <==
	* I0915 19:22:52.434096       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0915 19:22:52.442402       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0915 19:22:52.442449       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0915 19:22:52.449631       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0915 19:22:52.449779       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554!
	I0915 19:22:52.449737       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"edcec5d9-3929-420f-ac85-43ebcaef7c79", APIVersion:"v1", ResourceVersion:"540", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554 became leader
	I0915 19:22:52.550239       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554!
	

                                                
                                                
-- /stdout --
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20210915191717-498219 -n pause-20210915191717-498219
helpers_test.go:262: (dbg) Run:  kubectl --context pause-20210915191717-498219 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:271: non-running pods: 
helpers_test.go:273: ======> post-mortem[TestPause/serial/Pause]: describe non-running pods <======
helpers_test.go:276: (dbg) Run:  kubectl --context pause-20210915191717-498219 describe pod 

                                                
                                                
=== CONT  TestPause/serial/Pause
helpers_test.go:276: (dbg) Non-zero exit: kubectl --context pause-20210915191717-498219 describe pod : exit status 1 (70.056354ms)

                                                
                                                
** stderr ** 
	error: resource name may not be empty

                                                
                                                
** /stderr **
helpers_test.go:278: kubectl --context pause-20210915191717-498219 describe pod : exit status 1
--- FAIL: TestPause/serial/Pause (15.26s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (2.78s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:77: (dbg) Run:  out/minikube-linux-amd64 status -p pause-20210915191717-498219 --output=json --layout=cluster
status_test.go:80: expected command to fail, but it succeeded: out/minikube-linux-amd64 status -p pause-20210915191717-498219 --output=json --layout=cluster
<nil>
helpers_test.go:223: -----------------------post-mortem--------------------------------
helpers_test.go:231: ======>  post-mortem[TestPause/serial/VerifyStatus]: docker inspect <======
helpers_test.go:232: (dbg) Run:  docker inspect pause-20210915191717-498219
helpers_test.go:236: (dbg) docker inspect pause-20210915191717-498219:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74",
	        "Created": "2021-09-15T19:20:44.739194513Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 639632,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2021-09-15T19:20:45.450816177Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:83b5a81388468b1ffcd3874b4f24c1406c63c33ac07797cc8bed6ad0207d36a8",
	        "ResolvConfPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/hostname",
	        "HostsPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/hosts",
	        "LogPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74-json.log",
	        "Name": "/pause-20210915191717-498219",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "pause-20210915191717-498219:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "pause-20210915191717-498219",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "Capabilities": null,
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 0,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [
	                {
	                    "PathOnHost": "/dev/fuse",
	                    "PathInContainer": "/dev/fuse",
	                    "CgroupPermissions": "rwm"
	                }
	            ],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 0,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e-init/diff:/var/lib/docker/overlay2/0f8a10c746fedd8d666b9dae9bdd481a4ecb3bdc1c19c1763f5067cb6f6ec480/diff:/var/lib/docker/overlay2/f54dd51211f7fd37ed9e7e1b70117531d83c45068e0d908bb274324aaab9559e/diff:/var/lib/docker/overlay2/db8bcdf3259b37def0e8daacd8a4b91582e91b1335c4898bead8f0570ee379f4/diff:/var/lib/docker/overlay2/38faf25fee6b5c923ea643302bba2da4194356f1ecd1442a2371c90afb025b10/diff:/var/lib/docker/overlay2/c4a1a3e49e5edffd417be1158a98868c52bdfc84e62524f2c795e427d987e984/diff:/var/lib/docker/overlay2/e68c2d7fd8912bc6f5e5c4fd63053076de99a4d27b5ac2d087e97b170c724fbd/diff:/var/lib/docker/overlay2/c74734152182eae7a2408058cc612acaac307696039525cbf809638bdc5f0291/diff:/var/lib/docker/overlay2/871cb5ebce097dd4aeeed897eae2f2516c492acd2cf20e22a9bd621400d03fab/diff:/var/lib/docker/overlay2/c6de31e81e924f091a3674cc807ae856aaaf0bd75eede35b8012e555a78482f8/diff:/var/lib/docker/overlay2/5cb89b
dcb371bd4714cf4cc592534e708077fc8ba74ac5611767920d2e72b515/diff:/var/lib/docker/overlay2/855cba59b338da688aa696b251e03ec2f0d9dc95537b26265f31042b64dbcc2d/diff:/var/lib/docker/overlay2/68e4b369a0e1b1a42b5b9874ee9fa0849598643096f78bd2ff9f86e7f0dee281/diff:/var/lib/docker/overlay2/7d9c9be2ec55a3cfaeb8e493bde1f09d3e07500aa41b31d9dc92e3a045bfaa88/diff:/var/lib/docker/overlay2/e229f9da50c177e6addfce418c74667438f518d5821a0f714cb58a3968830c71/diff:/var/lib/docker/overlay2/ef41fa20aaf0f3e8b0f0873abea368bc5dfaf6684783ca409e3d6dfa74ca2b33/diff:/var/lib/docker/overlay2/8160677224d3d0ba75ceac5e22adbe4420f58aa9df575a4fa1eb16cfa5d36cb1/diff:/var/lib/docker/overlay2/747c3fc9ab1ea2616d662bd3b2e2f1ddbdac907a6eea86ac017e9ce3e66dc4d9/diff:/var/lib/docker/overlay2/f8eb124418298912c3691320300767eabaeae37f352f56c2d0e5a40dd97b0bc2/diff:/var/lib/docker/overlay2/c37f4c78c3026a8785fb4aca9fa78dc5ac21307cb3bfbf746bacec078e037770/diff:/var/lib/docker/overlay2/ee71c4960738cdf41b558b5aa16215f18299ecf0b241560a77477f080674ba8c/diff:/var/lib/d
ocker/overlay2/f2132a0cc49a4383ce675ba6870120bd2c58077afad82ab90d066c0651128e1d/diff:/var/lib/docker/overlay2/44200c5ed83b044737127b23b0b15c55e21152acc08ba98910e0dcb93835c4d5/diff:/var/lib/docker/overlay2/22bce5e99989e32cb7a1f876e412e03427623b5cb70e4709d0336c2cae5f4b37/diff:/var/lib/docker/overlay2/ccfb925585c3768c7aba8e731873849181bedce4d441b3095c1abfd310c405e1/diff:/var/lib/docker/overlay2/a90553cf4067ab91ee5ed23daf5f3aab785ded168917688d3c11e7eb856cc869/diff:/var/lib/docker/overlay2/dc493bca572baf2fff7143d6c551dc24acb22082e51a68200466da7510d37550/diff:/var/lib/docker/overlay2/e4fdd0a7dd5c09a7507c2e66bb44972d2db20fd3c58d2191eaa45291e1a47321/diff:/var/lib/docker/overlay2/4badf8f702a906675401fab2bb8327dafc5e0098b8a40e8ae31d3f4337c5539e/diff:/var/lib/docker/overlay2/d7a568f51d57ee1283764757ae3c91db612a7acb01906d88f7321359f27d4dcb/diff:/var/lib/docker/overlay2/123e8c40e6520b691981a6af80c211632618f36cb297ef8a28376985e8b9eddf/diff:/var/lib/docker/overlay2/fcfefbd58c332906200403538c8d881d31cbd97ecd5a2e223b198713731
51469/diff:/var/lib/docker/overlay2/a9e5b72b4ba31d329ac284cad558db42f24197775aaabfd188f2846a0a4ce96d/diff:/var/lib/docker/overlay2/7916e1ed717fc8628e14637400ba911d6e64209e501841613f69224c999b54f8/diff:/var/lib/docker/overlay2/3c121fd6f387f06c1b3a211eb1d7db64ffd333a873146a734de241e936ab5322/diff:/var/lib/docker/overlay2/9958539b4278fcc1c310de22689891aba5f238a94351d3c645b9dacba922241b/diff:/var/lib/docker/overlay2/c6c60f0d02b1e1aad2ea4fa1fb017d98e1ca4602689452dbd721342c0927fc6a/diff:/var/lib/docker/overlay2/e61aabb9eb2161801d4795e4a00f41afd54c504a52aeeef70d49d2a4f47fcd99/diff:/var/lib/docker/overlay2/a69e80d9160e6158cf9f37881d60928bf3221341b1fffe8d2855488233278102/diff:/var/lib/docker/overlay2/f76fd1ba3588d22f5228ab597df7a62e20a79217c1712dbc33e20061e12891c6/diff",
	                "MergedDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/merged",
	                "UpperDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/diff",
	                "WorkDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "pause-20210915191717-498219",
	                "Source": "/var/lib/docker/volumes/pause-20210915191717-498219/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "pause-20210915191717-498219",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "pause-20210915191717-498219",
	                "name.minikube.sigs.k8s.io": "pause-20210915191717-498219",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "27118836b403ba46eaa0c5f84b51105679f32ab8d48b0cf3d1809c92f7eab313",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33158"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33156"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33153"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33155"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33154"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/27118836b403",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "pause-20210915191717-498219": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.76.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "475715a3ea2c"
	                    ],
	                    "NetworkID": "b9847da4d513dbef2974381ee64c2c1cc6dd8d925ac1a45cdcc366eac6d6da5c",
	                    "EndpointID": "fdae2a292c54522fc39bfc656e4fce6fd18fc8d9526f059c210503a13a336d70",
	                    "Gateway": "192.168.76.1",
	                    "IPAddress": "192.168.76.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:4c:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210915191717-498219 -n pause-20210915191717-498219
helpers_test.go:245: <<< TestPause/serial/VerifyStatus FAILED: start of post-mortem logs <<<
helpers_test.go:246: ======>  post-mortem[TestPause/serial/VerifyStatus]: minikube logs <======
helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20210915191717-498219 logs -n 25
helpers_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p pause-20210915191717-498219 logs -n 25: (1.054475282s)
helpers_test.go:253: TestPause/serial/VerifyStatus logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	| Command |                    Args                    |                  Profile                   |  User   | Version |          Start Time           |           End Time            |
	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	| delete  | -p                                         | test-preload-20210915191317-498219         | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:15:29 UTC | Wed, 15 Sep 2021 19:15:32 UTC |
	|         | test-preload-20210915191317-498219         |                                            |         |         |                               |                               |
	| start   | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:15:32 UTC | Wed, 15 Sep 2021 19:16:17 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	|         | --memory=2048 --driver=docker              |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| stop    | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:18 UTC | Wed, 15 Sep 2021 19:16:18 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	|         | --cancel-scheduled                         |                                            |         |         |                               |                               |
	| stop    | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:31 UTC | Wed, 15 Sep 2021 19:16:56 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	|         | --schedule 5s                              |                                            |         |         |                               |                               |
	| delete  | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:58 UTC | Wed, 15 Sep 2021 19:17:03 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	| delete  | -p                                         | insufficient-storage-20210915191703-498219 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:11 UTC | Wed, 15 Sep 2021 19:17:17 UTC |
	|         | insufficient-storage-20210915191703-498219 |                                            |         |         |                               |                               |
	| delete  | -p                                         | kubenet-20210915191717-498219              | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:17:17 UTC |
	|         | kubenet-20210915191717-498219              |                                            |         |         |                               |                               |
	| delete  | -p                                         | flannel-20210915191717-498219              | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:17:18 UTC |
	|         | flannel-20210915191717-498219              |                                            |         |         |                               |                               |
	| delete  | -p false-20210915191718-498219             | false-20210915191718-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:18 UTC | Wed, 15 Sep 2021 19:17:19 UTC |
	| start   | -p                                         | missing-upgrade-20210915191719-498219      | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:18:43 UTC | Wed, 15 Sep 2021 19:19:26 UTC |
	|         | missing-upgrade-20210915191719-498219      |                                            |         |         |                               |                               |
	|         | --memory=2200 --alsologtostderr            |                                            |         |         |                               |                               |
	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | missing-upgrade-20210915191719-498219      | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:19:26 UTC | Wed, 15 Sep 2021 19:19:29 UTC |
	|         | missing-upgrade-20210915191719-498219      |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:19:29 UTC | Wed, 15 Sep 2021 19:20:14 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.14.0               |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| stop    | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:20:14 UTC | Wed, 15 Sep 2021 19:20:35 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	| start   | -p                                         | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:21:46 UTC |
	|         | force-systemd-env-20210915191717-498219    |                                            |         |         |                               |                               |
	|         | --memory=2048 --alsologtostderr            |                                            |         |         |                               |                               |
	|         | -v=5 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| -p      | force-systemd-env-20210915191717-498219    | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:46 UTC | Wed, 15 Sep 2021 19:21:46 UTC |
	|         | ssh cat /etc/containerd/config.toml        |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:20:35 UTC | Wed, 15 Sep 2021 19:21:48 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.22.2-rc.0          |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:46 UTC | Wed, 15 Sep 2021 19:21:50 UTC |
	|         | force-systemd-env-20210915191717-498219    |                                            |         |         |                               |                               |
	| start   | -p                                         | offline-containerd-20210915191717-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:21:56 UTC |
	|         | offline-containerd-20210915191717-498219   |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --memory=2048       |                                            |         |         |                               |                               |
	|         | --wait=true --driver=docker                |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | offline-containerd-20210915191717-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:56 UTC | Wed, 15 Sep 2021 19:22:01 UTC |
	|         | offline-containerd-20210915191717-498219   |                                            |         |         |                               |                               |
	| start   | -p pause-20210915191717-498219             | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:22:36 UTC |
	|         | --memory=2048                              |                                            |         |         |                               |                               |
	|         | --install-addons=false                     |                                            |         |         |                               |                               |
	|         | --wait=all --driver=docker                 |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| start   | -p pause-20210915191717-498219             | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:22:37 UTC | Wed, 15 Sep 2021 19:22:53 UTC |
	|         | --alsologtostderr                          |                                            |         |         |                               |                               |
	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:48 UTC | Wed, 15 Sep 2021 19:22:53 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.22.2-rc.0          |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| -p      | pause-20210915191717-498219                | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:23:04 UTC | Wed, 15 Sep 2021 19:23:05 UTC |
	|         | logs -n 25                                 |                                            |         |         |                               |                               |
	| delete  | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:22:53 UTC | Wed, 15 Sep 2021 19:23:05 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	| -p      | pause-20210915191717-498219                | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:23:06 UTC | Wed, 15 Sep 2021 19:23:07 UTC |
	|         | logs -n 25                                 |                                            |         |         |                               |                               |
	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2021/09/15 19:23:08
	Running on machine: debian-jenkins-agent-1
	Binary: Built with gc go1.17 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0915 19:23:08.338662  661434 out.go:298] Setting OutFile to fd 1 ...
	I0915 19:23:08.338901  661434 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:23:08.338919  661434 out.go:311] Setting ErrFile to fd 2...
	I0915 19:23:08.338925  661434 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:23:08.339071  661434 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	I0915 19:23:08.339454  661434 out.go:305] Setting JSON to false
	I0915 19:23:08.387952  661434 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-1","uptime":18346,"bootTime":1631715442,"procs":262,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}
	I0915 19:23:08.388120  661434 start.go:121] virtualization: kvm guest
	I0915 19:23:08.391808  661434 out.go:177] * [force-systemd-flag-20210915192308-498219] minikube v1.23.0 on Debian 9.13 (kvm/amd64)
	I0915 19:23:08.393454  661434 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	I0915 19:23:08.391997  661434 notify.go:169] Checking for updates...
	I0915 19:23:08.395035  661434 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0915 19:23:08.396410  661434 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube
	I0915 19:23:08.397936  661434 out.go:177]   - MINIKUBE_LOCATION=12425
	I0915 19:23:08.398603  661434 config.go:177] Loaded profile config "pause-20210915191717-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 19:23:08.398733  661434 config.go:177] Loaded profile config "running-upgrade-20210915192201-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0915 19:23:08.398834  661434 config.go:177] Loaded profile config "stopped-upgrade-20210915192150-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0915 19:23:08.398895  661434 driver.go:343] Setting default libvirt URI to qemu:///system
	I0915 19:23:08.457674  661434 docker.go:132] docker version: linux-19.03.15
	I0915 19:23:08.457812  661434 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 19:23:08.568631  661434 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:45 OomKillDisable:true NGoroutines:53 SystemTime:2021-09-15 19:23:08.507692821 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 19:23:08.568742  661434 docker.go:237] overlay module found
	I0915 19:23:08.571138  661434 out.go:177] * Using the docker driver based on user configuration
	I0915 19:23:08.571167  661434 start.go:278] selected driver: docker
	I0915 19:23:08.571175  661434 start.go:751] validating driver "docker" against <nil>
	I0915 19:23:08.571201  661434 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
	W0915 19:23:08.571250  661434 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.
	W0915 19:23:08.571286  661434 out.go:242] ! Your cgroup does not allow setting memory.
	I0915 19:23:08.572861  661434 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities
	I0915 19:23:08.573992  661434 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 19:23:08.699784  661434 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:45 OomKillDisable:true NGoroutines:53 SystemTime:2021-09-15 19:23:08.619158282 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 19:23:08.699903  661434 start_flags.go:264] no existing cluster config was found, will generate one from the flags 
	I0915 19:23:08.700084  661434 start_flags.go:719] Wait components to verify : map[apiserver:true system_pods:true]
	I0915 19:23:08.700108  661434 cni.go:93] Creating CNI manager for ""
	I0915 19:23:08.700120  661434 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet
	I0915 19:23:08.700133  661434 cni.go:217] auto-setting extra-config to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0915 19:23:08.700143  661434 cni.go:222] extra-config set to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0915 19:23:08.700148  661434 start_flags.go:273] Found "CNI" CNI - setting NetworkPlugin=cni
	I0915 19:23:08.700160  661434 start_flags.go:278] config:
	{Name:force-systemd-flag-20210915192308-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:force-systemd-flag-20210915192308-498219 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:c
luster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 19:23:08.702638  661434 out.go:177] * Starting control plane node force-systemd-flag-20210915192308-498219 in cluster force-systemd-flag-20210915192308-498219
	I0915 19:23:08.702676  661434 cache.go:118] Beginning downloading kic base image for docker with containerd
	I0915 19:23:08.704136  661434 out.go:177] * Pulling base image ...
	I0915 19:23:08.704174  661434 preload.go:131] Checking if preload exists for k8s version v1.22.1 and runtime containerd
	I0915 19:23:08.704217  661434 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4
	I0915 19:23:08.704218  661434 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon
	I0915 19:23:08.704232  661434 cache.go:57] Caching tarball of preloaded images
	I0915 19:23:08.704410  661434 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0915 19:23:08.704429  661434 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.1 on containerd
	I0915 19:23:08.704552  661434 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/force-systemd-flag-20210915192308-498219/config.json ...
	I0915 19:23:08.704582  661434 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/force-systemd-flag-20210915192308-498219/config.json: {Name:mka76c844874e21b876099e093ac1643da3f90ce Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0915 19:23:08.850760  661434 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull
	I0915 19:23:08.850795  661434 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load
	I0915 19:23:08.850814  661434 cache.go:206] Successfully downloaded all kic artifacts
	I0915 19:23:08.850870  661434 start.go:313] acquiring machines lock for force-systemd-flag-20210915192308-498219: {Name:mkc32223430342e18ab7395f1cdbdb2ec6fb46f1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:08.851014  661434 start.go:317] acquired machines lock for "force-systemd-flag-20210915192308-498219" in 121.212µs
	I0915 19:23:08.851045  661434 start.go:89] Provisioning new machine with config: &{Name:force-systemd-flag-20210915192308-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:force-systemd-flag-20210915192308-498219 Namesp
ace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0} &{Name: IP: Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}
	I0915 19:23:08.851150  661434 start.go:126] createHost starting for "" (driver="docker")
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID
	8a0ee0c424319       6e38f40d628db       17 seconds ago       Running             storage-provisioner       0                   f553a8f9f4bdb
	4e3e2ce59d5c1       8d147537fb7d1       49 seconds ago       Running             coredns                   0                   7ea0d242ee6d7
	add40aaf7d1e1       6de166512aa22       About a minute ago   Running             kindnet-cni               0                   84d365a86ab31
	0f8eb1bcec3c0       36c4ebbc9d979       About a minute ago   Running             kube-proxy                0                   615b93865a245
	ffa7fe563436a       6e002eb89a881       About a minute ago   Running             kube-controller-manager   0                   9801458e1a86a
	f9a6017a48e43       aca5ededae9c8       About a minute ago   Running             kube-scheduler            0                   88a3889c95bb5
	c59a5411d0a43       f30469a2491a5       About a minute ago   Running             kube-apiserver            0                   af1e2cc7dc24b
	68c751171dcd7       0048118155842       About a minute ago   Running             etcd                      0                   d9f651544d709
	
	* 
	* ==> containerd <==
	* -- Logs begin at Wed 2021-09-15 19:20:45 UTC, end at Wed 2021-09-15 19:23:09 UTC. --
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289115815Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289128254Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289138345Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289254269Z" level=warning msg="`default_runtime` is deprecated, please use `default_runtime_name` to reference the default configuration you have defined in `runtimes`"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289308982Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:default DefaultRuntime:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} UntrustedWorkloadRuntime:{Type: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} Runtimes:map[default:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} runc:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:0xc0003e8f60 PrivilegedWithoutHostDevices:false BaseRuntimeSpec:}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:false} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPlugi
nConfDir:/etc/cni/net.mk NetworkPluginMaxConfNum:1 NetworkPluginConfTemplate:} Registry:{Mirrors:map[docker.io:{Endpoints:[https://registry-1.docker.io]}] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:} DisableTCPService:true StreamServerAddress: StreamServerPort:10010 StreamIdleTimeout:4h0m0s EnableSelinux:false SelinuxCategoryRange:1024 SandboxImage:k8s.gcr.io/pause:3.5 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true IgnoreImageDefinedVolumes:false} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289381402Z" level=info msg="Connect containerd service"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289437523Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\""
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290081182Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290147751Z" level=info msg="Start subscribing containerd event"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290222669Z" level=info msg="Start recovering state"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290327818Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290751047Z" level=info msg=serving... address=/run/containerd/containerd.sock
	Sep 15 19:22:39 pause-20210915191717-498219 systemd[1]: Started containerd container runtime.
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.292542658Z" level=info msg="containerd successfully booted in 0.059289s"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373258157Z" level=info msg="Start event monitor"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373302442Z" level=info msg="Start snapshots syncer"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373315590Z" level=info msg="Start cni network conf syncer"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373323115Z" level=info msg="Start streaming server"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.004127018Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:b89fc9f6-92a3-4764-a891-43683f852797,Namespace:kube-system,Attempt:0,}"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.022589782Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406 pid=3354
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.189609846Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:b89fc9f6-92a3-4764-a891-43683f852797,Namespace:kube-system,Attempt:0,} returns sandbox id \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.192476910Z" level=info msg="CreateContainer within sandbox \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.264711641Z" level=info msg="CreateContainer within sandbox \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.265309072Z" level=info msg="StartContainer for \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.426381063Z" level=info msg="StartContainer for \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\" returns successfully"
	
	* 
	* ==> coredns [4e3e2ce59d5c18a575c0fcd0817a37be6f3100ed723ce065f62dde7f1eb0a51c] <==
	* .:53
	[INFO] plugin/reload: Running configuration MD5 = e58989e162233e5f3ebed8edb075da2b
	CoreDNS-1.8.4
	linux/amd64, go1.16.4, 053c4d5
	
	* 
	* ==> describe nodes <==
	* Name:               pause-20210915191717-498219
	Roles:              control-plane,master
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=pause-20210915191717-498219
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=66748304c4ca78061b718f95ac626a53ac360876
	                    minikube.k8s.io/name=pause-20210915191717-498219
	                    minikube.k8s.io/updated_at=2021_09_15T19_21_45_0700
	                    minikube.k8s.io/version=v1.23.0
	                    node-role.kubernetes.io/control-plane=
	                    node-role.kubernetes.io/master=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Wed, 15 Sep 2021 19:21:41 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  pause-20210915191717-498219
	  AcquireTime:     <unset>
	  RenewTime:       Wed, 15 Sep 2021 19:23:01 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:22:15 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.76.2
	  Hostname:    pause-20210915191717-498219
	Capacity:
	  cpu:                8
	  ephemeral-storage:  309568300Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32951368Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  309568300Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32951368Ki
	  pods:               110
	System Info:
	  Machine ID:                 4b5e5cdd53d44f5ab575bb522d42acca
	  System UUID:                6c096439-dfd0-4bf2-9d72-aed11150be6a
	  Boot ID:                    d1f48c72-ac32-4c43-bb38-cbe6179197b8
	  Kernel Version:             4.9.0-16-amd64
	  OS Image:                   Ubuntu 20.04.2 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.4.9
	  Kubelet Version:            v1.22.1
	  Kube-Proxy Version:         v1.22.1
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (8 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  kube-system                 coredns-78fcd69978-87x4l                               100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     73s
	  kube-system                 etcd-pause-20210915191717-498219                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         85s
	  kube-system                 kindnet-m5zrb                                          100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      73s
	  kube-system                 kube-apiserver-pause-20210915191717-498219             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         87s
	  kube-system                 kube-controller-manager-pause-20210915191717-498219    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         85s
	  kube-system                 kube-proxy-x78hq                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         73s
	  kube-system                 kube-scheduler-pause-20210915191717-498219             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         85s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         19s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                850m (10%!)(MISSING)  100m (1%!)(MISSING)
	  memory             220Mi (0%!)(MISSING)  220Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From     Message
	  ----    ------                   ----               ----     -------
	  Normal  Starting                 95s                kubelet  Starting kubelet.
	  Normal  NodeHasSufficientMemory  94s (x3 over 94s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    94s (x3 over 94s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     94s (x2 over 94s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  94s                kubelet  Updated Node Allocatable limit across pods
	  Normal  Starting                 86s                kubelet  Starting kubelet.
	  Normal  NodeHasSufficientMemory  85s                kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    85s                kubelet  Node pause-20210915191717-498219 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     85s                kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  85s                kubelet  Updated Node Allocatable limit across pods
	  Normal  NodeReady                55s                kubelet  Node pause-20210915191717-498219 status is now: NodeReady
	
	* 
	* ==> dmesg <==
	* [  +0.000003] ll header: 00000000: ff ff ff ff ff ff 0e cc 37 49 8f cc 08 06        ........7I....
	[Sep15 19:15] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:16] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth7ac412fc
	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 0e 03 57 43 c3 f6 08 06        ........WC....
	[Sep15 19:17] cgroup: cgroup2: unknown option "nsdelegate"
	[ +24.447023] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:19] cgroup: cgroup2: unknown option "nsdelegate"
	[ +29.341499] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:20] cgroup: cgroup2: unknown option "nsdelegate"
	[  +7.752932] cgroup: cgroup2: unknown option "nsdelegate"
	[  +1.168476] cgroup: cgroup2: unknown option "nsdelegate"
	[  +0.883365] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:21] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethc7f59d8a
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff fe 62 09 bc 6e 99 08 06        .......b..n...
	[  +4.026078] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethae8b0a09
	[  +0.000001] ll header: 00000000: ff ff ff ff ff ff 76 c5 05 52 bd 2c 08 06        ......v..R.,..
	[  +2.294384] IPv4: martian source 10.244.0.3 from 10.244.0.3, on dev vethee7d8cc4
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 42 f1 0d a2 67 58 08 06        ......B...gX..
	[Sep15 19:22] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth2dc59167
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 32 6a 0d 06 42 d3 08 06        ......2j..B...
	[  +2.711472] IPv4: martian source 10.244.0.4 from 10.244.0.4, on dev veth4dd80444
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 66 3a 96 9d c7 49 08 06        ......f:...I..
	[ +13.259098] cgroup: cgroup2: unknown option "nsdelegate"
	[  +0.866691] IPv4: martian source 10.244.0.5 from 10.244.0.5, on dev vethbabe3094
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 5e 69 cf 9d 65 c0 08 06        ......^i..e...
	
	* 
	* ==> etcd [68c751171dcd7d647b503ddd8a23729be4c80075be04f4911d2d09c0cd2ef1d6] <==
	* {"level":"warn","ts":"2021-09-15T19:23:02.791Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:01.794Z","time spent":"997.399319ms","remote":"127.0.0.1:38158","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":599,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" mod_revision:524 > success:<request_put:<key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" value_size:531 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" > >"}
	{"level":"info","ts":"2021-09-15T19:23:02.791Z","caller":"traceutil/trace.go:171","msg":"trace[1006913848] linearizableReadLoop","detail":"{readStateIndex:570; appliedIndex:569; }","duration":"2.591966237s","start":"2021-09-15T19:23:00.199Z","end":"2021-09-15T19:23:02.791Z","steps":["trace[1006913848] 'read index received'  (duration: 913.0891ms)","trace[1006913848] 'applied index is now lower than readState.Index'  (duration: 1.678875336s)"],"step_count":2}
	{"level":"warn","ts":"2021-09-15T19:23:02.791Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:22:59.852Z","time spent":"2.939831065s","remote":"127.0.0.1:38060","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1114,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" mod_revision:545 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" value_size:1041 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" > >"}
	{"level":"warn","ts":"2021-09-15T19:23:03.292Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":15638323004940351675,"retry-timeout":"500ms"}
	{"level":"warn","ts":"2021-09-15T19:23:03.792Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":15638323004940351675,"retry-timeout":"500ms"}
	{"level":"warn","ts":"2021-09-15T19:23:03.996Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.056444461s","expected-duration":"1s"}
	{"level":"info","ts":"2021-09-15T19:23:03.996Z","caller":"traceutil/trace.go:171","msg":"trace[994553924] linearizableReadLoop","detail":"{readStateIndex:571; appliedIndex:571; }","duration":"1.204874877s","start":"2021-09-15T19:23:02.791Z","end":"2021-09-15T19:23:03.996Z","steps":["trace[994553924] 'read index received'  (duration: 1.204854238s)","trace[994553924] 'applied index is now lower than readState.Index'  (duration: 18.873µs)"],"step_count":2}
	{"level":"warn","ts":"2021-09-15T19:23:03.997Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.792511814s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085\" ","response":"range_response_count:1 size:787"}
	{"level":"info","ts":"2021-09-15T19:23:03.997Z","caller":"traceutil/trace.go:171","msg":"trace[1998177799] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085; range_end:; response_count:1; response_revision:548; }","duration":"1.792595532s","start":"2021-09-15T19:23:02.205Z","end":"2021-09-15T19:23:03.997Z","steps":["trace[1998177799] 'agreement among raft nodes before linearized reading'  (duration: 1.791882626s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.997Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.204Z","time spent":"1.792678664s","remote":"127.0.0.1:38010","response type":"/etcdserverpb.KV/Range","request count":0,"request size":90,"response count":1,"response size":810,"request content":"key:\"/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.738122175s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[1177029980] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:548; }","duration":"1.738172063s","start":"2021-09-15T19:23:02.259Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[1177029980] 'agreement among raft nodes before linearized reading'  (duration: 1.736912592s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.259Z","time spent":"1.738230286s","remote":"127.0.0.1:38250","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":28,"request content":"key:\"/registry/health\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.493659597s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[2071497708] range","detail":"{range_begin:/registry/networkpolicies/; range_end:/registry/networkpolicies0; response_count:0; response_revision:548; }","duration":"1.493691663s","start":"2021-09-15T19:23:02.504Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[2071497708] 'agreement among raft nodes before linearized reading'  (duration: 1.492292928s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.504Z","time spent":"1.493733527s","remote":"127.0.0.1:38170","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":0,"response size":28,"request content":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.789357774s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"830.565162ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/default\" ","response":"range_response_count:1 size:343"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[1354754751] range","detail":"{range_begin:/registry/namespaces/default; range_end:; response_count:1; response_revision:548; }","duration":"830.609729ms","start":"2021-09-15T19:23:03.167Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[1354754751] 'agreement among raft nodes before linearized reading'  (duration: 828.900071ms)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:03.167Z","time spent":"830.664651ms","remote":"127.0.0.1:38054","response type":"/etcdserverpb.KV/Range","request count":0,"request size":30,"response count":1,"response size":366,"request content":"key:\"/registry/namespaces/default\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.827186779s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" ","response":"range_response_count:1 size:4936"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[554460785] range","detail":"{range_begin:/registry/minions/; range_end:/registry/minions0; response_count:1; response_revision:548; }","duration":"2.827248402s","start":"2021-09-15T19:23:01.171Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[554460785] 'agreement among raft nodes before linearized reading'  (duration: 2.825281977s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:01.171Z","time spent":"2.827299141s","remote":"127.0.0.1:38068","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":1,"response size":4959,"request content":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" "}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[483421495] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:548; }","duration":"1.789408028s","start":"2021-09-15T19:23:02.209Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[483421495] 'agreement among raft nodes before linearized reading'  (duration: 1.787721349s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.209Z","time spent":"1.78980824s","remote":"127.0.0.1:38250","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":28,"request content":"key:\"/registry/health\" "}
	
	* 
	* ==> kernel <==
	*  19:23:10 up  5:05,  0 users,  load average: 9.32, 4.68, 2.41
	Linux pause-20210915191717-498219 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.2 LTS"
	
	* 
	* ==> kube-apiserver [c59a5411d0a433dc24d4b92cbfe6897ccefe0c7791ebb38fa78a538f7451455a] <==
	* Trace[1935315716]: ---"Transaction committed" 2940ms (19:23:02.792)
	Trace[1935315716]: [2.941327631s] [2.941327631s] END
	I0915 19:23:02.792544       1 trace.go:205] Trace[160500084]: "GuaranteedUpdate etcd3" type:*coordination.Lease (15-Sep-2021 19:23:01.793) (total time: 999ms):
	Trace[160500084]: ---"Transaction committed" 998ms (19:23:02.792)
	Trace[160500084]: [999.103304ms] [999.103304ms] END
	I0915 19:23:02.792708       1 trace.go:205] Trace[83543991]: "Update" url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath,user-agent:storage-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:17b9dfd5-5501-45f7-b3cd-14cd9632e7f8,client:192.168.76.2,accept:application/json, */*,protocol:HTTP/2.0 (15-Sep-2021 19:22:59.850) (total time: 2941ms):
	Trace[83543991]: ---"Object stored in database" 2941ms (19:23:02.792)
	Trace[83543991]: [2.941792202s] [2.941792202s] END
	I0915 19:23:02.792810       1 trace.go:205] Trace[461359119]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210915191717-498219,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:3e3d5ee5-e1f3-456b-82ca-ded19898029f,client:192.168.76.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:23:01.793) (total time: 999ms):
	Trace[461359119]: ---"Object stored in database" 999ms (19:23:02.792)
	Trace[461359119]: [999.531575ms] [999.531575ms] END
	I0915 19:23:03.999781       1 trace.go:205] Trace[988981254]: "Get" url:/api/v1/namespaces/default,user-agent:kube-apiserver/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:a108ccf7-c083-4410-8746-c981a95f95e5,client:127.0.0.1,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (15-Sep-2021 19:23:03.167) (total time: 832ms):
	Trace[988981254]: ---"About to write a response" 832ms (19:23:03.999)
	Trace[988981254]: [832.240765ms] [832.240765ms] END
	I0915 19:23:04.000645       1 trace.go:205] Trace[1888490700]: "GuaranteedUpdate etcd3" type:*core.Event (15-Sep-2021 19:23:02.204) (total time: 1796ms):
	Trace[1888490700]: ---"initial value restored" 1794ms (19:23:03.998)
	Trace[1888490700]: [1.796117778s] [1.796117778s] END
	I0915 19:23:04.000797       1 trace.go:205] Trace[257925177]: "Patch" url:/api/v1/namespaces/kube-system/events/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:d6b68a1f-53de-45b4-957d-2071d61dd2f7,client:192.168.76.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:23:02.204) (total time: 1796ms):
	Trace[257925177]: ---"About to apply patch" 1794ms (19:23:03.998)
	Trace[257925177]: [1.796536176s] [1.796536176s] END
	I0915 19:23:04.001586       1 trace.go:205] Trace[607332746]: "List etcd3" key:/minions,resourceVersion:,resourceVersionMatch:,limit:0,continue: (15-Sep-2021 19:23:01.171) (total time: 2830ms):
	Trace[607332746]: [2.830446727s] [2.830446727s] END
	I0915 19:23:04.002006       1 trace.go:205] Trace[557314537]: "List" url:/api/v1/nodes,user-agent:kindnetd/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:daca3847-81a5-42d6-bc90-18e89e76e274,client:192.168.76.2,accept:application/json, */*,protocol:HTTP/2.0 (15-Sep-2021 19:23:01.171) (total time: 2830ms):
	Trace[557314537]: ---"Listing from storage done" 2830ms (19:23:04.001)
	Trace[557314537]: [2.830874436s] [2.830874436s] END
	
	* 
	* ==> kube-controller-manager [ffa7fe563436a7ae8d7cecd36b9ff38df2bcc5435d8942a21f17d65219db5c80] <==
	* I0915 19:21:56.621813       1 shared_informer.go:247] Caches are synced for GC 
	I0915 19:21:56.666633       1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring 
	I0915 19:21:56.737104       1 shared_informer.go:247] Caches are synced for HPA 
	I0915 19:21:56.771555       1 shared_informer.go:247] Caches are synced for TTL after finished 
	I0915 19:21:56.776318       1 shared_informer.go:247] Caches are synced for resource quota 
	I0915 19:21:56.786816       1 shared_informer.go:247] Caches are synced for bootstrap_signer 
	I0915 19:21:56.814494       1 shared_informer.go:247] Caches are synced for cronjob 
	I0915 19:21:56.815608       1 shared_informer.go:247] Caches are synced for job 
	I0915 19:21:56.816836       1 shared_informer.go:247] Caches are synced for resource quota 
	I0915 19:21:56.849367       1 shared_informer.go:247] Caches are synced for crt configmap 
	I0915 19:21:57.069440       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"
	I0915 19:21:57.245086       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0915 19:21:57.258419       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0915 19:21:57.258447       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0915 19:21:57.424897       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-m5zrb"
	I0915 19:21:57.426662       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-x78hq"
	I0915 19:21:57.620526       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-2cj9r"
	I0915 19:21:57.626422       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-87x4l"
	I0915 19:21:57.831742       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"
	I0915 19:21:57.850742       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-2cj9r"
	I0915 19:22:21.597081       1 node_lifecycle_controller.go:1191] Controller detected that some Nodes are Ready. Exiting master disruption mode.
	W0915 19:22:30.529868       1 endpointslice_controller.go:306] Error syncing endpoint slices for service "kube-system/kube-dns", retrying. Error: failed to update kube-dns-bdr96 EndpointSlice for Service kube-system/kube-dns: etcdserver: request timed out
	I0915 19:22:30.529995       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Service" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpointSlices" message="Error updating Endpoint Slices for Service kube-system/kube-dns: failed to update kube-dns-bdr96 EndpointSlice for Service kube-system/kube-dns: etcdserver: request timed out"
	I0915 19:22:30.535845       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint kube-system/kube-dns: etcdserver: request timed out"
	I0915 19:22:31.128758       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint kube-system/kube-dns: Operation cannot be fulfilled on endpoints \"kube-dns\": the object has been modified; please apply your changes to the latest version and try again"
	
	* 
	* ==> kube-proxy [0f8eb1bcec3c031e531b43c748eea2d33912cf7d55db49e7ea71778813c0c49d] <==
	* I0915 19:22:00.149349       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I0915 19:22:00.149412       1 server_others.go:140] Detected node IP 192.168.76.2
	W0915 19:22:00.149443       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy
	I0915 19:22:00.224185       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary
	I0915 19:22:00.224227       1 server_others.go:212] Using iptables Proxier.
	I0915 19:22:00.224243       1 server_others.go:219] creating dualStackProxier for iptables.
	W0915 19:22:00.224268       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
	I0915 19:22:00.224633       1 server.go:649] Version: v1.22.1
	I0915 19:22:00.225573       1 config.go:315] Starting service config controller
	I0915 19:22:00.225594       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0915 19:22:00.225648       1 config.go:224] Starting endpoint slice config controller
	I0915 19:22:00.225654       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	E0915 19:22:00.237347       1 event_broadcaster.go:253] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pause-20210915191717-498219.16a5152c5a0d5dba", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, EventTime:v1.MicroTime{Time:time.Time{wall:0xc048afd60d6ce200, ext:146529520, loc:(*time.Location)(0x2d81340)}}, Series:(*v1.EventSeries)(nil), ReportingController:"kube-proxy", ReportingInstance:"kube-proxy-pause-20210915191717-498219", Action:"StartKubeProxy", Reason:"Starting", Regarding:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"pause
-20210915191717-498219", UID:"pause-20210915191717-498219", APIVersion:"", ResourceVersion:"", FieldPath:""}, Related:(*v1.ObjectReference)(nil), Note:"", Type:"Normal", DeprecatedSource:v1.EventSource{Component:"", Host:""}, DeprecatedFirstTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedLastTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedCount:0}': 'Event "pause-20210915191717-498219.16a5152c5a0d5dba" is invalid: involvedObject.namespace: Invalid value: "": does not match event.namespace' (will not retry!)
	I0915 19:22:00.326477       1 shared_informer.go:247] Caches are synced for service config 
	I0915 19:22:00.326476       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	
	* 
	* ==> kube-scheduler [f9a6017a48e430457074558a4f8587452f4bc9da312b0a267d9b4c66ec6698a3] <==
	* E0915 19:21:41.760210       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0915 19:21:41.760303       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0915 19:21:41.760377       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0915 19:21:41.760448       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0915 19:21:41.761375       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:41.761567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0915 19:21:41.761758       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0915 19:21:41.761874       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0915 19:21:41.762011       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0915 19:21:41.762094       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:41.762150       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0915 19:21:41.762299       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0915 19:21:42.633569       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:42.633572       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:42.656483       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0915 19:21:42.750028       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0915 19:21:42.834567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0915 19:21:42.847835       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0915 19:21:42.905891       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0915 19:21:42.913872       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0915 19:21:44.504439       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.560422       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.562990       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.565584       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	I0915 19:21:45.957351       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Wed 2021-09-15 19:20:45 UTC, end at Wed 2021-09-15 19:23:10 UTC. --
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466612    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/78449e93-ea1e-46cd-92ca-d416ecbee251-xtables-lock\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466634    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-cni-cfg\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466653    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-xtables-lock\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466668    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-lib-modules\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466731    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78449e93-ea1e-46cd-92ca-d416ecbee251-lib-modules\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466791    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wcrs\" (UniqueName: \"kubernetes.io/projected/78449e93-ea1e-46cd-92ca-d416ecbee251-kube-api-access-2wcrs\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466837    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdpn4\" (UniqueName: \"kubernetes.io/projected/b75f582d-6b59-4a29-8f66-5670fc372ef7-kube-api-access-cdpn4\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:22:00 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:00.444629    1889 kubelet.go:2332] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:19.178108    1889 event.go:264] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-pause-20210915191717-498219", UID:"7711ec5bdcd091468467911b3afef6b2", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"Unhealthy", Message:"Readiness
probe failed: HTTP probe failed with statuscode: 500", Source:v1.EventSource{Component:"kubelet", Host:"pause-20210915191717-498219"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc048afd909eda885, ext:27550152024, loc:(*time.Location)(0x55f11597a660)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc048afd909eda885, ext:27550152024, loc:(*time.Location)(0x55f11597a660)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'etcdserver: request timed out' (will not retry!)
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.742011    1889 topology_manager.go:200] "Topology Admit Handler"
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.807643    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bacedd06-5f04-410d-bb77-6d7082ac74d8-config-volume\") pod \"coredns-78fcd69978-87x4l\" (UID: \"bacedd06-5f04-410d-bb77-6d7082ac74d8\") "
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.807946    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrzf5\" (UniqueName: \"kubernetes.io/projected/bacedd06-5f04-410d-bb77-6d7082ac74d8-kube-api-access-mrzf5\") pod \"coredns-78fcd69978-87x4l\" (UID: \"bacedd06-5f04-410d-bb77-6d7082ac74d8\") "
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: W0915 19:22:39.201764    1889 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: W0915 19:22:39.201764    1889 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251093    1889 remote_runtime.go:207] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\"" filter="&PodSandboxFilter{Id:,State:&PodSandboxStateValue{State:SANDBOX_READY,},LabelSelector:map[string]string{},}"
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251148    1889 kuberuntime_sandbox.go:281] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251163    1889 kubelet_pods.go:1117] "Error listing containers" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251179    1889 kubelet.go:2143] "Failed cleaning pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.322958    1889 remote_runtime.go:207] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\"" filter="nil"
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.323017    1889 kuberuntime_sandbox.go:281] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.323041    1889 generic.go:205] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.752088    1889 remote_runtime.go:86] "Version from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.700577    1889 topology_manager.go:200] "Topology Admit Handler"
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.739217    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/b89fc9f6-92a3-4764-a891-43683f852797-tmp\") pod \"storage-provisioner\" (UID: \"b89fc9f6-92a3-4764-a891-43683f852797\") "
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.739305    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnnvv\" (UniqueName: \"kubernetes.io/projected/b89fc9f6-92a3-4764-a891-43683f852797-kube-api-access-mnnvv\") pod \"storage-provisioner\" (UID: \"b89fc9f6-92a3-4764-a891-43683f852797\") "
	
	* 
	* ==> storage-provisioner [8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de] <==
	* I0915 19:22:52.434096       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0915 19:22:52.442402       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0915 19:22:52.442449       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0915 19:22:52.449631       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0915 19:22:52.449779       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554!
	I0915 19:22:52.449737       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"edcec5d9-3929-420f-ac85-43ebcaef7c79", APIVersion:"v1", ResourceVersion:"540", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554 became leader
	I0915 19:22:52.550239       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554!
	

                                                
                                                
-- /stdout --
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20210915191717-498219 -n pause-20210915191717-498219
helpers_test.go:262: (dbg) Run:  kubectl --context pause-20210915191717-498219 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:271: non-running pods: 
helpers_test.go:273: ======> post-mortem[TestPause/serial/VerifyStatus]: describe non-running pods <======
helpers_test.go:276: (dbg) Run:  kubectl --context pause-20210915191717-498219 describe pod 
helpers_test.go:276: (dbg) Non-zero exit: kubectl --context pause-20210915191717-498219 describe pod : exit status 1 (100.363341ms)

                                                
                                                
** stderr ** 
	error: resource name may not be empty

                                                
                                                
** /stderr **
helpers_test.go:278: kubectl --context pause-20210915191717-498219 describe pod : exit status 1
--- FAIL: TestPause/serial/VerifyStatus (2.78s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (6.51s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:108: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-20210915191717-498219 --alsologtostderr -v=5
pause_test.go:108: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p pause-20210915191717-498219 --alsologtostderr -v=5: exit status 80 (2.428417551s)

                                                
                                                
-- stdout --
	* Pausing node pause-20210915191717-498219 ... 
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0915 19:23:11.829208  663330 out.go:298] Setting OutFile to fd 1 ...
	I0915 19:23:11.829291  663330 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:23:11.829296  663330 out.go:311] Setting ErrFile to fd 2...
	I0915 19:23:11.829301  663330 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:23:11.829408  663330 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	I0915 19:23:11.829589  663330 out.go:305] Setting JSON to false
	I0915 19:23:11.829610  663330 mustload.go:65] Loading cluster: pause-20210915191717-498219
	I0915 19:23:11.829928  663330 config.go:177] Loaded profile config "pause-20210915191717-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 19:23:11.830469  663330 cli_runner.go:115] Run: docker container inspect pause-20210915191717-498219 --format={{.State.Status}}
	I0915 19:23:11.873274  663330 host.go:66] Checking if "pause-20210915191717-498219" exists ...
	I0915 19:23:11.873582  663330 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 19:23:11.974072  663330 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:5 ContainersRunning:4 ContainersPaused:0 ContainersStopped:1 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:64 OomKillDisable:true NGoroutines:72 SystemTime:2021-09-15 19:23:11.919682369 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 19:23:11.974735  663330 pause.go:58] "namespaces" [kube-system kubernetes-dashboard storage-gluster istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cni: container-runtime:docker cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) host-dns-resolver:%!s(bool=
true) host-only-cidr:192.168.99.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/12425/minikube-v1.23.0-1631662909-12425.iso https://github.com/kubernetes/minikube/releases/download/v1.23.0-1631662909-12425/minikube-v1.23.0-1631662909-12425.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.23.0-1631662909-12425.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qemu-uri:qemu:///system listen-address: memory: mount:%!s(bool=false) mount-string:/home/jenkins:/minikube-host namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plu
gin: nfs-share:[] nfs-shares-root:/nfsshares no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:pause-20210915191717-498219 purge:%!s(bool=false) registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) schedule:0s service-cluster-ip-range:10.96.0.0/12 ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true) wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"
	I0915 19:23:11.980883  663330 out.go:177] * Pausing node pause-20210915191717-498219 ... 
	I0915 19:23:11.980920  663330 host.go:66] Checking if "pause-20210915191717-498219" exists ...
	I0915 19:23:11.981295  663330 ssh_runner.go:152] Run: systemctl --version
	I0915 19:23:11.981341  663330 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20210915191717-498219
	I0915 19:23:12.025345  663330 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33158 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/pause-20210915191717-498219/id_rsa Username:docker}
	I0915 19:23:12.112489  663330 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
	I0915 19:23:12.123274  663330 pause.go:50] kubelet running: true
	I0915 19:23:12.123343  663330 ssh_runner.go:152] Run: sudo systemctl disable --now kubelet
	I0915 19:23:12.296250  663330 retry.go:31] will retry after 276.165072ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1
	stdout:
	
	stderr:
	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install disable kubelet
	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.
	I0915 19:23:12.572601  663330 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
	I0915 19:23:12.582928  663330 pause.go:50] kubelet running: true
	I0915 19:23:12.582997  663330 ssh_runner.go:152] Run: sudo systemctl disable --now kubelet
	I0915 19:23:12.707996  663330 retry.go:31] will retry after 540.190908ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1
	stdout:
	
	stderr:
	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install disable kubelet
	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.
	I0915 19:23:13.248680  663330 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
	I0915 19:23:13.259520  663330 pause.go:50] kubelet running: true
	I0915 19:23:13.259586  663330 ssh_runner.go:152] Run: sudo systemctl disable --now kubelet
	I0915 19:23:13.375888  663330 retry.go:31] will retry after 655.06503ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1
	stdout:
	
	stderr:
	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install disable kubelet
	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.
	I0915 19:23:14.031523  663330 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
	I0915 19:23:14.042139  663330 pause.go:50] kubelet running: true
	I0915 19:23:14.042204  663330 ssh_runner.go:152] Run: sudo systemctl disable --now kubelet
	I0915 19:23:14.181511  663330 out.go:177] 
	W0915 19:23:14.181686  663330 out.go:242] X Exiting due to GUEST_PAUSE: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1
	stdout:
	
	stderr:
	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install disable kubelet
	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.
	
	X Exiting due to GUEST_PAUSE: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1
	stdout:
	
	stderr:
	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install disable kubelet
	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.
	
	W0915 19:23:14.181707  663330 out.go:242] * 
	* 
	W0915 19:23:14.199683  663330 out.go:242] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_1.log                   │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_1.log                   │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0915 19:23:14.201477  663330 out.go:177] 

                                                
                                                
** /stderr **
pause_test.go:110: failed to pause minikube with args: "out/minikube-linux-amd64 pause -p pause-20210915191717-498219 --alsologtostderr -v=5" : exit status 80
helpers_test.go:223: -----------------------post-mortem--------------------------------
helpers_test.go:231: ======>  post-mortem[TestPause/serial/PauseAgain]: docker inspect <======
helpers_test.go:232: (dbg) Run:  docker inspect pause-20210915191717-498219
helpers_test.go:236: (dbg) docker inspect pause-20210915191717-498219:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74",
	        "Created": "2021-09-15T19:20:44.739194513Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 639632,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2021-09-15T19:20:45.450816177Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:83b5a81388468b1ffcd3874b4f24c1406c63c33ac07797cc8bed6ad0207d36a8",
	        "ResolvConfPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/hostname",
	        "HostsPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/hosts",
	        "LogPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74-json.log",
	        "Name": "/pause-20210915191717-498219",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "pause-20210915191717-498219:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "pause-20210915191717-498219",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "Capabilities": null,
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 0,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [
	                {
	                    "PathOnHost": "/dev/fuse",
	                    "PathInContainer": "/dev/fuse",
	                    "CgroupPermissions": "rwm"
	                }
	            ],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 0,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e-init/diff:/var/lib/docker/overlay2/0f8a10c746fedd8d666b9dae9bdd481a4ecb3bdc1c19c1763f5067cb6f6ec480/diff:/var/lib/docker/overlay2/f54dd51211f7fd37ed9e7e1b70117531d83c45068e0d908bb274324aaab9559e/diff:/var/lib/docker/overlay2/db8bcdf3259b37def0e8daacd8a4b91582e91b1335c4898bead8f0570ee379f4/diff:/var/lib/docker/overlay2/38faf25fee6b5c923ea643302bba2da4194356f1ecd1442a2371c90afb025b10/diff:/var/lib/docker/overlay2/c4a1a3e49e5edffd417be1158a98868c52bdfc84e62524f2c795e427d987e984/diff:/var/lib/docker/overlay2/e68c2d7fd8912bc6f5e5c4fd63053076de99a4d27b5ac2d087e97b170c724fbd/diff:/var/lib/docker/overlay2/c74734152182eae7a2408058cc612acaac307696039525cbf809638bdc5f0291/diff:/var/lib/docker/overlay2/871cb5ebce097dd4aeeed897eae2f2516c492acd2cf20e22a9bd621400d03fab/diff:/var/lib/docker/overlay2/c6de31e81e924f091a3674cc807ae856aaaf0bd75eede35b8012e555a78482f8/diff:/var/lib/docker/overlay2/5cb89b
dcb371bd4714cf4cc592534e708077fc8ba74ac5611767920d2e72b515/diff:/var/lib/docker/overlay2/855cba59b338da688aa696b251e03ec2f0d9dc95537b26265f31042b64dbcc2d/diff:/var/lib/docker/overlay2/68e4b369a0e1b1a42b5b9874ee9fa0849598643096f78bd2ff9f86e7f0dee281/diff:/var/lib/docker/overlay2/7d9c9be2ec55a3cfaeb8e493bde1f09d3e07500aa41b31d9dc92e3a045bfaa88/diff:/var/lib/docker/overlay2/e229f9da50c177e6addfce418c74667438f518d5821a0f714cb58a3968830c71/diff:/var/lib/docker/overlay2/ef41fa20aaf0f3e8b0f0873abea368bc5dfaf6684783ca409e3d6dfa74ca2b33/diff:/var/lib/docker/overlay2/8160677224d3d0ba75ceac5e22adbe4420f58aa9df575a4fa1eb16cfa5d36cb1/diff:/var/lib/docker/overlay2/747c3fc9ab1ea2616d662bd3b2e2f1ddbdac907a6eea86ac017e9ce3e66dc4d9/diff:/var/lib/docker/overlay2/f8eb124418298912c3691320300767eabaeae37f352f56c2d0e5a40dd97b0bc2/diff:/var/lib/docker/overlay2/c37f4c78c3026a8785fb4aca9fa78dc5ac21307cb3bfbf746bacec078e037770/diff:/var/lib/docker/overlay2/ee71c4960738cdf41b558b5aa16215f18299ecf0b241560a77477f080674ba8c/diff:/var/lib/d
ocker/overlay2/f2132a0cc49a4383ce675ba6870120bd2c58077afad82ab90d066c0651128e1d/diff:/var/lib/docker/overlay2/44200c5ed83b044737127b23b0b15c55e21152acc08ba98910e0dcb93835c4d5/diff:/var/lib/docker/overlay2/22bce5e99989e32cb7a1f876e412e03427623b5cb70e4709d0336c2cae5f4b37/diff:/var/lib/docker/overlay2/ccfb925585c3768c7aba8e731873849181bedce4d441b3095c1abfd310c405e1/diff:/var/lib/docker/overlay2/a90553cf4067ab91ee5ed23daf5f3aab785ded168917688d3c11e7eb856cc869/diff:/var/lib/docker/overlay2/dc493bca572baf2fff7143d6c551dc24acb22082e51a68200466da7510d37550/diff:/var/lib/docker/overlay2/e4fdd0a7dd5c09a7507c2e66bb44972d2db20fd3c58d2191eaa45291e1a47321/diff:/var/lib/docker/overlay2/4badf8f702a906675401fab2bb8327dafc5e0098b8a40e8ae31d3f4337c5539e/diff:/var/lib/docker/overlay2/d7a568f51d57ee1283764757ae3c91db612a7acb01906d88f7321359f27d4dcb/diff:/var/lib/docker/overlay2/123e8c40e6520b691981a6af80c211632618f36cb297ef8a28376985e8b9eddf/diff:/var/lib/docker/overlay2/fcfefbd58c332906200403538c8d881d31cbd97ecd5a2e223b198713731
51469/diff:/var/lib/docker/overlay2/a9e5b72b4ba31d329ac284cad558db42f24197775aaabfd188f2846a0a4ce96d/diff:/var/lib/docker/overlay2/7916e1ed717fc8628e14637400ba911d6e64209e501841613f69224c999b54f8/diff:/var/lib/docker/overlay2/3c121fd6f387f06c1b3a211eb1d7db64ffd333a873146a734de241e936ab5322/diff:/var/lib/docker/overlay2/9958539b4278fcc1c310de22689891aba5f238a94351d3c645b9dacba922241b/diff:/var/lib/docker/overlay2/c6c60f0d02b1e1aad2ea4fa1fb017d98e1ca4602689452dbd721342c0927fc6a/diff:/var/lib/docker/overlay2/e61aabb9eb2161801d4795e4a00f41afd54c504a52aeeef70d49d2a4f47fcd99/diff:/var/lib/docker/overlay2/a69e80d9160e6158cf9f37881d60928bf3221341b1fffe8d2855488233278102/diff:/var/lib/docker/overlay2/f76fd1ba3588d22f5228ab597df7a62e20a79217c1712dbc33e20061e12891c6/diff",
	                "MergedDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/merged",
	                "UpperDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/diff",
	                "WorkDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "pause-20210915191717-498219",
	                "Source": "/var/lib/docker/volumes/pause-20210915191717-498219/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "pause-20210915191717-498219",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "pause-20210915191717-498219",
	                "name.minikube.sigs.k8s.io": "pause-20210915191717-498219",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "27118836b403ba46eaa0c5f84b51105679f32ab8d48b0cf3d1809c92f7eab313",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33158"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33156"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33153"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33155"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33154"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/27118836b403",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "pause-20210915191717-498219": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.76.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "475715a3ea2c"
	                    ],
	                    "NetworkID": "b9847da4d513dbef2974381ee64c2c1cc6dd8d925ac1a45cdcc366eac6d6da5c",
	                    "EndpointID": "fdae2a292c54522fc39bfc656e4fce6fd18fc8d9526f059c210503a13a336d70",
	                    "Gateway": "192.168.76.1",
	                    "IPAddress": "192.168.76.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:4c:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210915191717-498219 -n pause-20210915191717-498219
helpers_test.go:245: <<< TestPause/serial/PauseAgain FAILED: start of post-mortem logs <<<
helpers_test.go:246: ======>  post-mortem[TestPause/serial/PauseAgain]: minikube logs <======
helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20210915191717-498219 logs -n 25
helpers_test.go:253: TestPause/serial/PauseAgain logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	| Command |                    Args                    |                  Profile                   |  User   | Version |          Start Time           |           End Time            |
	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	| stop    | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:18 UTC | Wed, 15 Sep 2021 19:16:18 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	|         | --cancel-scheduled                         |                                            |         |         |                               |                               |
	| stop    | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:31 UTC | Wed, 15 Sep 2021 19:16:56 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	|         | --schedule 5s                              |                                            |         |         |                               |                               |
	| delete  | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:58 UTC | Wed, 15 Sep 2021 19:17:03 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	| delete  | -p                                         | insufficient-storage-20210915191703-498219 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:11 UTC | Wed, 15 Sep 2021 19:17:17 UTC |
	|         | insufficient-storage-20210915191703-498219 |                                            |         |         |                               |                               |
	| delete  | -p                                         | kubenet-20210915191717-498219              | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:17:17 UTC |
	|         | kubenet-20210915191717-498219              |                                            |         |         |                               |                               |
	| delete  | -p                                         | flannel-20210915191717-498219              | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:17:18 UTC |
	|         | flannel-20210915191717-498219              |                                            |         |         |                               |                               |
	| delete  | -p false-20210915191718-498219             | false-20210915191718-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:18 UTC | Wed, 15 Sep 2021 19:17:19 UTC |
	| start   | -p                                         | missing-upgrade-20210915191719-498219      | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:18:43 UTC | Wed, 15 Sep 2021 19:19:26 UTC |
	|         | missing-upgrade-20210915191719-498219      |                                            |         |         |                               |                               |
	|         | --memory=2200 --alsologtostderr            |                                            |         |         |                               |                               |
	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | missing-upgrade-20210915191719-498219      | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:19:26 UTC | Wed, 15 Sep 2021 19:19:29 UTC |
	|         | missing-upgrade-20210915191719-498219      |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:19:29 UTC | Wed, 15 Sep 2021 19:20:14 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.14.0               |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| stop    | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:20:14 UTC | Wed, 15 Sep 2021 19:20:35 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	| start   | -p                                         | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:21:46 UTC |
	|         | force-systemd-env-20210915191717-498219    |                                            |         |         |                               |                               |
	|         | --memory=2048 --alsologtostderr            |                                            |         |         |                               |                               |
	|         | -v=5 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| -p      | force-systemd-env-20210915191717-498219    | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:46 UTC | Wed, 15 Sep 2021 19:21:46 UTC |
	|         | ssh cat /etc/containerd/config.toml        |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:20:35 UTC | Wed, 15 Sep 2021 19:21:48 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.22.2-rc.0          |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:46 UTC | Wed, 15 Sep 2021 19:21:50 UTC |
	|         | force-systemd-env-20210915191717-498219    |                                            |         |         |                               |                               |
	| start   | -p                                         | offline-containerd-20210915191717-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:21:56 UTC |
	|         | offline-containerd-20210915191717-498219   |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --memory=2048       |                                            |         |         |                               |                               |
	|         | --wait=true --driver=docker                |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | offline-containerd-20210915191717-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:56 UTC | Wed, 15 Sep 2021 19:22:01 UTC |
	|         | offline-containerd-20210915191717-498219   |                                            |         |         |                               |                               |
	| start   | -p pause-20210915191717-498219             | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:22:36 UTC |
	|         | --memory=2048                              |                                            |         |         |                               |                               |
	|         | --install-addons=false                     |                                            |         |         |                               |                               |
	|         | --wait=all --driver=docker                 |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| start   | -p pause-20210915191717-498219             | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:22:37 UTC | Wed, 15 Sep 2021 19:22:53 UTC |
	|         | --alsologtostderr                          |                                            |         |         |                               |                               |
	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:48 UTC | Wed, 15 Sep 2021 19:22:53 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.22.2-rc.0          |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| -p      | pause-20210915191717-498219                | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:23:04 UTC | Wed, 15 Sep 2021 19:23:05 UTC |
	|         | logs -n 25                                 |                                            |         |         |                               |                               |
	| delete  | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:22:53 UTC | Wed, 15 Sep 2021 19:23:05 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	| -p      | pause-20210915191717-498219                | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:23:06 UTC | Wed, 15 Sep 2021 19:23:07 UTC |
	|         | logs -n 25                                 |                                            |         |         |                               |                               |
	| -p      | pause-20210915191717-498219                | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:23:09 UTC | Wed, 15 Sep 2021 19:23:10 UTC |
	|         | logs -n 25                                 |                                            |         |         |                               |                               |
	| unpause | -p pause-20210915191717-498219             | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:23:11 UTC | Wed, 15 Sep 2021 19:23:11 UTC |
	|         | --alsologtostderr -v=5                     |                                            |         |         |                               |                               |
	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2021/09/15 19:23:08
	Running on machine: debian-jenkins-agent-1
	Binary: Built with gc go1.17 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0915 19:23:08.338662  661434 out.go:298] Setting OutFile to fd 1 ...
	I0915 19:23:08.338901  661434 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:23:08.338919  661434 out.go:311] Setting ErrFile to fd 2...
	I0915 19:23:08.338925  661434 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:23:08.339071  661434 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	I0915 19:23:08.339454  661434 out.go:305] Setting JSON to false
	I0915 19:23:08.387952  661434 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-1","uptime":18346,"bootTime":1631715442,"procs":262,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}
	I0915 19:23:08.388120  661434 start.go:121] virtualization: kvm guest
	I0915 19:23:08.391808  661434 out.go:177] * [force-systemd-flag-20210915192308-498219] minikube v1.23.0 on Debian 9.13 (kvm/amd64)
	I0915 19:23:08.393454  661434 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	I0915 19:23:08.391997  661434 notify.go:169] Checking for updates...
	I0915 19:23:08.395035  661434 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0915 19:23:08.396410  661434 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube
	I0915 19:23:08.397936  661434 out.go:177]   - MINIKUBE_LOCATION=12425
	I0915 19:23:08.398603  661434 config.go:177] Loaded profile config "pause-20210915191717-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 19:23:08.398733  661434 config.go:177] Loaded profile config "running-upgrade-20210915192201-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0915 19:23:08.398834  661434 config.go:177] Loaded profile config "stopped-upgrade-20210915192150-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0915 19:23:08.398895  661434 driver.go:343] Setting default libvirt URI to qemu:///system
	I0915 19:23:08.457674  661434 docker.go:132] docker version: linux-19.03.15
	I0915 19:23:08.457812  661434 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 19:23:08.568631  661434 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:45 OomKillDisable:true NGoroutines:53 SystemTime:2021-09-15 19:23:08.507692821 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 19:23:08.568742  661434 docker.go:237] overlay module found
	I0915 19:23:08.571138  661434 out.go:177] * Using the docker driver based on user configuration
	I0915 19:23:08.571167  661434 start.go:278] selected driver: docker
	I0915 19:23:08.571175  661434 start.go:751] validating driver "docker" against <nil>
	I0915 19:23:08.571201  661434 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
	W0915 19:23:08.571250  661434 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.
	W0915 19:23:08.571286  661434 out.go:242] ! Your cgroup does not allow setting memory.
	I0915 19:23:08.572861  661434 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities
	I0915 19:23:08.573992  661434 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 19:23:08.699784  661434 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:45 OomKillDisable:true NGoroutines:53 SystemTime:2021-09-15 19:23:08.619158282 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 19:23:08.699903  661434 start_flags.go:264] no existing cluster config was found, will generate one from the flags 
	I0915 19:23:08.700084  661434 start_flags.go:719] Wait components to verify : map[apiserver:true system_pods:true]
	I0915 19:23:08.700108  661434 cni.go:93] Creating CNI manager for ""
	I0915 19:23:08.700120  661434 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet
	I0915 19:23:08.700133  661434 cni.go:217] auto-setting extra-config to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0915 19:23:08.700143  661434 cni.go:222] extra-config set to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0915 19:23:08.700148  661434 start_flags.go:273] Found "CNI" CNI - setting NetworkPlugin=cni
	I0915 19:23:08.700160  661434 start_flags.go:278] config:
	{Name:force-systemd-flag-20210915192308-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:force-systemd-flag-20210915192308-498219 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:c
luster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 19:23:08.702638  661434 out.go:177] * Starting control plane node force-systemd-flag-20210915192308-498219 in cluster force-systemd-flag-20210915192308-498219
	I0915 19:23:08.702676  661434 cache.go:118] Beginning downloading kic base image for docker with containerd
	I0915 19:23:08.704136  661434 out.go:177] * Pulling base image ...
	I0915 19:23:08.704174  661434 preload.go:131] Checking if preload exists for k8s version v1.22.1 and runtime containerd
	I0915 19:23:08.704217  661434 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4
	I0915 19:23:08.704218  661434 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon
	I0915 19:23:08.704232  661434 cache.go:57] Caching tarball of preloaded images
	I0915 19:23:08.704410  661434 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0915 19:23:08.704429  661434 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.1 on containerd
	I0915 19:23:08.704552  661434 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/force-systemd-flag-20210915192308-498219/config.json ...
	I0915 19:23:08.704582  661434 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/force-systemd-flag-20210915192308-498219/config.json: {Name:mka76c844874e21b876099e093ac1643da3f90ce Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0915 19:23:08.850760  661434 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull
	I0915 19:23:08.850795  661434 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load
	I0915 19:23:08.850814  661434 cache.go:206] Successfully downloaded all kic artifacts
	I0915 19:23:08.850870  661434 start.go:313] acquiring machines lock for force-systemd-flag-20210915192308-498219: {Name:mkc32223430342e18ab7395f1cdbdb2ec6fb46f1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:08.851014  661434 start.go:317] acquired machines lock for "force-systemd-flag-20210915192308-498219" in 121.212µs
	I0915 19:23:08.851045  661434 start.go:89] Provisioning new machine with config: &{Name:force-systemd-flag-20210915192308-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:force-systemd-flag-20210915192308-498219 Namesp
ace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0} &{Name: IP: Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}
	I0915 19:23:08.851150  661434 start.go:126] createHost starting for "" (driver="docker")
	I0915 19:23:05.935263  660452 out.go:177] * Updating the running docker "running-upgrade-20210915192201-498219" container ...
	I0915 19:23:05.935309  660452 machine.go:88] provisioning docker machine ...
	I0915 19:23:05.935363  660452 ubuntu.go:169] provisioning hostname "running-upgrade-20210915192201-498219"
	I0915 19:23:05.935446  660452 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20210915192201-498219
	I0915 19:23:05.983549  660452 main.go:130] libmachine: Using SSH client type: native
	I0915 19:23:05.983775  660452 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33166 <nil> <nil>}
	I0915 19:23:05.983792  660452 main.go:130] libmachine: About to run SSH command:
	sudo hostname running-upgrade-20210915192201-498219 && echo "running-upgrade-20210915192201-498219" | sudo tee /etc/hostname
	I0915 19:23:06.124999  660452 main.go:130] libmachine: SSH cmd err, output: <nil>: running-upgrade-20210915192201-498219
	
	I0915 19:23:06.125085  660452 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20210915192201-498219
	I0915 19:23:06.172168  660452 main.go:130] libmachine: Using SSH client type: native
	I0915 19:23:06.172390  660452 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33166 <nil> <nil>}
	I0915 19:23:06.172418  660452 main.go:130] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\srunning-upgrade-20210915192201-498219' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 running-upgrade-20210915192201-498219/g' /etc/hosts;
				else 
					echo '127.0.1.1 running-upgrade-20210915192201-498219' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0915 19:23:06.262803  660452 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0
	I0915 19:23:06.263391  660452 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0
	I0915 19:23:06.264934  660452 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0
	I0915 19:23:06.275653  660452 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0
	I0915 19:23:06.311391  660452 main.go:130] libmachine: SSH cmd err, output: <nil>: 
	I0915 19:23:06.311429  660452 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157
/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube}
	I0915 19:23:06.313670  660452 ubuntu.go:177] setting up certificates
	I0915 19:23:06.313691  660452 provision.go:83] configureAuth start
	I0915 19:23:06.313766  660452 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" running-upgrade-20210915192201-498219
	I0915 19:23:06.375431  660452 provision.go:138] copyHostCerts
	I0915 19:23:06.375502  660452 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem, removing ...
	I0915 19:23:06.375513  660452 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem
	I0915 19:23:06.375580  660452 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem (1082 bytes)
	I0915 19:23:06.375670  660452 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem, removing ...
	I0915 19:23:06.375686  660452 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem
	I0915 19:23:06.375714  660452 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem (1123 bytes)
	I0915 19:23:06.375777  660452 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem, removing ...
	I0915 19:23:06.375790  660452 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem
	I0915 19:23:06.375815  660452 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem (1679 bytes)
	I0915 19:23:06.375863  660452 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem org=jenkins.running-upgrade-20210915192201-498219 san=[192.168.59.44 127.0.0.1 localhost 127.0.0.1 minikube running-upgrade-20210915192201-498219]
	I0915 19:23:06.386068  660452 image.go:177] found k8s.gcr.io/coredns:1.7.0 locally: &{UncompressedImageCore:0xc00061a230 lock:{state:0 sema:0} manifest:<nil>}
	I0915 19:23:06.386116  660452 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0
	I0915 19:23:06.485139  660452 provision.go:172] copyRemoteCerts
	I0915 19:23:06.485199  660452 ssh_runner.go:152] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0915 19:23:06.485249  660452 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20210915192201-498219
	I0915 19:23:06.552719  660452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33166 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/running-upgrade-20210915192201-498219/id_rsa Username:docker}
	I0915 19:23:06.658412  660452 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0915 19:23:06.682299  660452 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem --> /etc/docker/server.pem (1281 bytes)
	I0915 19:23:06.704998  660452 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0915 19:23:06.727508  660452 provision.go:86] duration metric: configureAuth took 413.801984ms
	I0915 19:23:06.727533  660452 ubuntu.go:193] setting minikube options for container-runtime
	I0915 19:23:06.727747  660452 config.go:177] Loaded profile config "running-upgrade-20210915192201-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0915 19:23:06.727762  660452 machine.go:91] provisioned docker machine in 792.445117ms
	I0915 19:23:06.727775  660452 start.go:267] post-start starting for "running-upgrade-20210915192201-498219" (driver="docker")
	I0915 19:23:06.727782  660452 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0915 19:23:06.727852  660452 ssh_runner.go:152] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0915 19:23:06.727893  660452 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20210915192201-498219
	I0915 19:23:06.810381  660452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33166 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/running-upgrade-20210915192201-498219/id_rsa Username:docker}
	I0915 19:23:06.897094  660452 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 exists
	I0915 19:23:06.897144  660452 cache.go:97] cache image "k8s.gcr.io/kube-controller-manager:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0" took 1.071734678s
	I0915 19:23:06.897164  660452 cache.go:81] save to tar file k8s.gcr.io/kube-controller-manager:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 succeeded
	I0915 19:23:06.917655  660452 ssh_runner.go:152] Run: cat /etc/os-release
	I0915 19:23:06.920667  660452 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0915 19:23:06.920693  660452 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0915 19:23:06.920717  660452 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0915 19:23:06.920728  660452 info.go:137] Remote host: Ubuntu 20.04.1 LTS
	I0915 19:23:06.920742  660452 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/addons for local assets ...
	I0915 19:23:06.920808  660452 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files for local assets ...
	I0915 19:23:06.920904  660452 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/4982192.pem -> 4982192.pem in /etc/ssl/certs
	I0915 19:23:06.921010  660452 ssh_runner.go:152] Run: sudo mkdir -p /etc/ssl/certs
	I0915 19:23:06.929384  660452 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/4982192.pem --> /etc/ssl/certs/4982192.pem (1708 bytes)
	I0915 19:23:06.951612  660452 start.go:270] post-start completed in 223.816314ms
	I0915 19:23:06.951688  660452 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0915 19:23:06.951729  660452 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20210915192201-498219
	I0915 19:23:07.025595  660452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33166 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/running-upgrade-20210915192201-498219/id_rsa Username:docker}
	I0915 19:23:07.044997  660452 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 exists
	I0915 19:23:07.045041  660452 cache.go:97] cache image "k8s.gcr.io/kube-scheduler:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0" took 1.219788608s
	I0915 19:23:07.045059  660452 cache.go:81] save to tar file k8s.gcr.io/kube-scheduler:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 succeeded
	I0915 19:23:07.123563  660452 fix.go:57] fixHost completed within 1.241807938s
	I0915 19:23:07.123592  660452 start.go:80] releasing machines lock for "running-upgrade-20210915192201-498219", held for 1.24186144s
	I0915 19:23:07.123675  660452 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" running-upgrade-20210915192201-498219
	I0915 19:23:07.174373  660452 ssh_runner.go:152] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0915 19:23:07.174441  660452 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20210915192201-498219
	I0915 19:23:07.229942  660452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33166 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/running-upgrade-20210915192201-498219/id_rsa Username:docker}
	I0915 19:23:07.389156  660452 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 exists
	I0915 19:23:07.389202  660452 cache.go:97] cache image "k8s.gcr.io/kube-apiserver:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0" took 1.56395339s
	I0915 19:23:07.389219  660452 cache.go:81] save to tar file k8s.gcr.io/kube-apiserver:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 succeeded
	I0915 19:23:07.430593  660452 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 exists
	I0915 19:23:07.430634  660452 cache.go:97] cache image "k8s.gcr.io/kube-proxy:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0" took 1.605315393s
	I0915 19:23:07.430649  660452 cache.go:81] save to tar file k8s.gcr.io/kube-proxy:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 succeeded
	I0915 19:23:08.951622  660452 image.go:177] found k8s.gcr.io/etcd:3.4.13-0 locally: &{UncompressedImageCore:0xc00061a040 lock:{state:0 sema:0} manifest:<nil>}
	I0915 19:23:08.951727  660452 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0
	I0915 19:23:09.083629  660452 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 exists
	I0915 19:23:09.083676  660452 cache.go:97] cache image "k8s.gcr.io/coredns:1.7.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0" took 3.25835954s
	I0915 19:23:09.083698  660452 cache.go:81] save to tar file k8s.gcr.io/coredns:1.7.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 succeeded
	I0915 19:23:08.853424  661434 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...
	I0915 19:23:08.853720  661434 start.go:160] libmachine.API.Create for "force-systemd-flag-20210915192308-498219" (driver="docker")
	I0915 19:23:08.853759  661434 client.go:168] LocalClient.Create starting
	I0915 19:23:08.853884  661434 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem
	I0915 19:23:08.853925  661434 main.go:130] libmachine: Decoding PEM data...
	I0915 19:23:08.853947  661434 main.go:130] libmachine: Parsing certificate...
	I0915 19:23:08.854018  661434 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem
	I0915 19:23:08.854044  661434 main.go:130] libmachine: Decoding PEM data...
	I0915 19:23:08.854063  661434 main.go:130] libmachine: Parsing certificate...
	I0915 19:23:08.854478  661434 cli_runner.go:115] Run: docker network inspect force-systemd-flag-20210915192308-498219 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0915 19:23:08.906778  661434 cli_runner.go:162] docker network inspect force-systemd-flag-20210915192308-498219 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0915 19:23:08.906964  661434 network_create.go:255] running [docker network inspect force-systemd-flag-20210915192308-498219] to gather additional debugging logs...
	I0915 19:23:08.906991  661434 cli_runner.go:115] Run: docker network inspect force-systemd-flag-20210915192308-498219
	W0915 19:23:08.961426  661434 cli_runner.go:162] docker network inspect force-systemd-flag-20210915192308-498219 returned with exit code 1
	I0915 19:23:08.961469  661434 network_create.go:258] error running [docker network inspect force-systemd-flag-20210915192308-498219]: docker network inspect force-systemd-flag-20210915192308-498219: exit status 1
	stdout:
	[]
	
	stderr:
	Error: No such network: force-systemd-flag-20210915192308-498219
	I0915 19:23:08.961485  661434 network_create.go:260] output of [docker network inspect force-systemd-flag-20210915192308-498219]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error: No such network: force-systemd-flag-20210915192308-498219
	
	** /stderr **
	I0915 19:23:08.961542  661434 cli_runner.go:115] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0915 19:23:09.024317  661434 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000114a70] misses:0}
	I0915 19:23:09.024383  661434 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
	I0915 19:23:09.024407  661434 network_create.go:106] attempt to create docker network force-systemd-flag-20210915192308-498219 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0915 19:23:09.024478  661434 cli_runner.go:115] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true force-systemd-flag-20210915192308-498219
	I0915 19:23:09.107440  661434 network_create.go:90] docker network force-systemd-flag-20210915192308-498219 192.168.49.0/24 created
	I0915 19:23:09.107475  661434 kic.go:106] calculated static IP "192.168.49.2" for the "force-systemd-flag-20210915192308-498219" container
	I0915 19:23:09.107523  661434 cli_runner.go:115] Run: docker ps -a --format {{.Names}}
	I0915 19:23:09.152584  661434 cli_runner.go:115] Run: docker volume create force-systemd-flag-20210915192308-498219 --label name.minikube.sigs.k8s.io=force-systemd-flag-20210915192308-498219 --label created_by.minikube.sigs.k8s.io=true
	I0915 19:23:09.198626  661434 oci.go:102] Successfully created a docker volume force-systemd-flag-20210915192308-498219
	I0915 19:23:09.198718  661434 cli_runner.go:115] Run: docker run --rm --name force-systemd-flag-20210915192308-498219-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-flag-20210915192308-498219 --entrypoint /usr/bin/test -v force-systemd-flag-20210915192308-498219:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 -d /var/lib
	I0915 19:23:10.026842  661434 oci.go:106] Successfully prepared a docker volume force-systemd-flag-20210915192308-498219
	W0915 19:23:10.026895  661434 oci.go:135] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0915 19:23:10.026905  661434 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.
	I0915 19:23:10.026922  661434 preload.go:131] Checking if preload exists for k8s version v1.22.1 and runtime containerd
	I0915 19:23:10.026958  661434 kic.go:179] Starting extracting preloaded images to volume ...
	I0915 19:23:10.026963  661434 cli_runner.go:115] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0915 19:23:10.027026  661434 cli_runner.go:115] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v force-systemd-flag-20210915192308-498219:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 -I lz4 -xf /preloaded.tar -C /extractDir
	I0915 19:23:10.132975  661434 cli_runner.go:115] Run: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname force-systemd-flag-20210915192308-498219 --name force-systemd-flag-20210915192308-498219 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-flag-20210915192308-498219 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=force-systemd-flag-20210915192308-498219 --network force-systemd-flag-20210915192308-498219 --ip 192.168.49.2 --volume force-systemd-flag-20210915192308-498219:/var --security-opt apparmor=unconfined --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56
	I0915 19:23:10.742004  661434 cli_runner.go:115] Run: docker container inspect force-systemd-flag-20210915192308-498219 --format={{.State.Running}}
	I0915 19:23:10.799435  661434 cli_runner.go:115] Run: docker container inspect force-systemd-flag-20210915192308-498219 --format={{.State.Status}}
	I0915 19:23:10.858892  661434 cli_runner.go:115] Run: docker exec force-systemd-flag-20210915192308-498219 stat /var/lib/dpkg/alternatives/iptables
	I0915 19:23:10.999260  661434 oci.go:281] the created container "force-systemd-flag-20210915192308-498219" has a running status.
	I0915 19:23:10.999290  661434 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/force-systemd-flag-20210915192308-498219/id_rsa...
	I0915 19:23:11.678269  661434 vm_assets.go:109] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/force-systemd-flag-20210915192308-498219/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0915 19:23:11.678341  661434 kic_runner.go:188] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/force-systemd-flag-20210915192308-498219/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0915 19:23:12.090449  661434 cli_runner.go:115] Run: docker container inspect force-systemd-flag-20210915192308-498219 --format={{.State.Status}}
	I0915 19:23:12.137300  661434 kic_runner.go:94] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0915 19:23:12.137335  661434 kic_runner.go:115] Args: [docker exec --privileged force-systemd-flag-20210915192308-498219 chown docker:docker /home/docker/.ssh/authorized_keys]
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID
	8a0ee0c424319       6e38f40d628db       23 seconds ago       Running             storage-provisioner       0                   f553a8f9f4bdb
	4e3e2ce59d5c1       8d147537fb7d1       54 seconds ago       Running             coredns                   0                   7ea0d242ee6d7
	add40aaf7d1e1       6de166512aa22       About a minute ago   Running             kindnet-cni               0                   84d365a86ab31
	0f8eb1bcec3c0       36c4ebbc9d979       About a minute ago   Running             kube-proxy                0                   615b93865a245
	ffa7fe563436a       6e002eb89a881       About a minute ago   Running             kube-controller-manager   0                   9801458e1a86a
	f9a6017a48e43       aca5ededae9c8       About a minute ago   Running             kube-scheduler            0                   88a3889c95bb5
	c59a5411d0a43       f30469a2491a5       About a minute ago   Running             kube-apiserver            0                   af1e2cc7dc24b
	68c751171dcd7       0048118155842       About a minute ago   Running             etcd                      0                   d9f651544d709
	
	* 
	* ==> containerd <==
	* -- Logs begin at Wed 2021-09-15 19:20:45 UTC, end at Wed 2021-09-15 19:23:15 UTC. --
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289115815Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289128254Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289138345Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289254269Z" level=warning msg="`default_runtime` is deprecated, please use `default_runtime_name` to reference the default configuration you have defined in `runtimes`"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289308982Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:default DefaultRuntime:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} UntrustedWorkloadRuntime:{Type: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} Runtimes:map[default:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} runc:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:0xc0003e8f60 PrivilegedWithoutHostDevices:false BaseRuntimeSpec:}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:false} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPlugi
nConfDir:/etc/cni/net.mk NetworkPluginMaxConfNum:1 NetworkPluginConfTemplate:} Registry:{Mirrors:map[docker.io:{Endpoints:[https://registry-1.docker.io]}] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:} DisableTCPService:true StreamServerAddress: StreamServerPort:10010 StreamIdleTimeout:4h0m0s EnableSelinux:false SelinuxCategoryRange:1024 SandboxImage:k8s.gcr.io/pause:3.5 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true IgnoreImageDefinedVolumes:false} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289381402Z" level=info msg="Connect containerd service"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289437523Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\""
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290081182Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290147751Z" level=info msg="Start subscribing containerd event"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290222669Z" level=info msg="Start recovering state"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290327818Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290751047Z" level=info msg=serving... address=/run/containerd/containerd.sock
	Sep 15 19:22:39 pause-20210915191717-498219 systemd[1]: Started containerd container runtime.
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.292542658Z" level=info msg="containerd successfully booted in 0.059289s"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373258157Z" level=info msg="Start event monitor"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373302442Z" level=info msg="Start snapshots syncer"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373315590Z" level=info msg="Start cni network conf syncer"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373323115Z" level=info msg="Start streaming server"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.004127018Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:b89fc9f6-92a3-4764-a891-43683f852797,Namespace:kube-system,Attempt:0,}"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.022589782Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406 pid=3354
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.189609846Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:b89fc9f6-92a3-4764-a891-43683f852797,Namespace:kube-system,Attempt:0,} returns sandbox id \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.192476910Z" level=info msg="CreateContainer within sandbox \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.264711641Z" level=info msg="CreateContainer within sandbox \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.265309072Z" level=info msg="StartContainer for \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.426381063Z" level=info msg="StartContainer for \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\" returns successfully"
	
	* 
	* ==> coredns [4e3e2ce59d5c18a575c0fcd0817a37be6f3100ed723ce065f62dde7f1eb0a51c] <==
	* .:53
	[INFO] plugin/reload: Running configuration MD5 = e58989e162233e5f3ebed8edb075da2b
	CoreDNS-1.8.4
	linux/amd64, go1.16.4, 053c4d5
	
	* 
	* ==> describe nodes <==
	* Name:               pause-20210915191717-498219
	Roles:              control-plane,master
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=pause-20210915191717-498219
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=66748304c4ca78061b718f95ac626a53ac360876
	                    minikube.k8s.io/name=pause-20210915191717-498219
	                    minikube.k8s.io/updated_at=2021_09_15T19_21_45_0700
	                    minikube.k8s.io/version=v1.23.0
	                    node-role.kubernetes.io/control-plane=
	                    node-role.kubernetes.io/master=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Wed, 15 Sep 2021 19:21:41 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  pause-20210915191717-498219
	  AcquireTime:     <unset>
	  RenewTime:       Wed, 15 Sep 2021 19:23:12 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:22:15 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.76.2
	  Hostname:    pause-20210915191717-498219
	Capacity:
	  cpu:                8
	  ephemeral-storage:  309568300Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32951368Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  309568300Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32951368Ki
	  pods:               110
	System Info:
	  Machine ID:                 4b5e5cdd53d44f5ab575bb522d42acca
	  System UUID:                6c096439-dfd0-4bf2-9d72-aed11150be6a
	  Boot ID:                    d1f48c72-ac32-4c43-bb38-cbe6179197b8
	  Kernel Version:             4.9.0-16-amd64
	  OS Image:                   Ubuntu 20.04.2 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.4.9
	  Kubelet Version:            v1.22.1
	  Kube-Proxy Version:         v1.22.1
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (8 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  kube-system                 coredns-78fcd69978-87x4l                               100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     78s
	  kube-system                 etcd-pause-20210915191717-498219                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         90s
	  kube-system                 kindnet-m5zrb                                          100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      78s
	  kube-system                 kube-apiserver-pause-20210915191717-498219             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         92s
	  kube-system                 kube-controller-manager-pause-20210915191717-498219    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         90s
	  kube-system                 kube-proxy-x78hq                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         78s
	  kube-system                 kube-scheduler-pause-20210915191717-498219             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         90s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         24s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                850m (10%!)(MISSING)  100m (1%!)(MISSING)
	  memory             220Mi (0%!)(MISSING)  220Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From     Message
	  ----    ------                   ----               ----     -------
	  Normal  Starting                 100s               kubelet  Starting kubelet.
	  Normal  NodeHasSufficientMemory  99s (x3 over 99s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    99s (x3 over 99s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     99s (x2 over 99s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  99s                kubelet  Updated Node Allocatable limit across pods
	  Normal  Starting                 91s                kubelet  Starting kubelet.
	  Normal  NodeHasSufficientMemory  90s                kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    90s                kubelet  Node pause-20210915191717-498219 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     90s                kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  90s                kubelet  Updated Node Allocatable limit across pods
	  Normal  NodeReady                60s                kubelet  Node pause-20210915191717-498219 status is now: NodeReady
	
	* 
	* ==> dmesg <==
	* [Sep15 19:15] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:16] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth7ac412fc
	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 0e 03 57 43 c3 f6 08 06        ........WC....
	[Sep15 19:17] cgroup: cgroup2: unknown option "nsdelegate"
	[ +24.447023] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:19] cgroup: cgroup2: unknown option "nsdelegate"
	[ +29.341499] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:20] cgroup: cgroup2: unknown option "nsdelegate"
	[  +7.752932] cgroup: cgroup2: unknown option "nsdelegate"
	[  +1.168476] cgroup: cgroup2: unknown option "nsdelegate"
	[  +0.883365] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:21] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethc7f59d8a
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff fe 62 09 bc 6e 99 08 06        .......b..n...
	[  +4.026078] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethae8b0a09
	[  +0.000001] ll header: 00000000: ff ff ff ff ff ff 76 c5 05 52 bd 2c 08 06        ......v..R.,..
	[  +2.294384] IPv4: martian source 10.244.0.3 from 10.244.0.3, on dev vethee7d8cc4
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 42 f1 0d a2 67 58 08 06        ......B...gX..
	[Sep15 19:22] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth2dc59167
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 32 6a 0d 06 42 d3 08 06        ......2j..B...
	[  +2.711472] IPv4: martian source 10.244.0.4 from 10.244.0.4, on dev veth4dd80444
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 66 3a 96 9d c7 49 08 06        ......f:...I..
	[ +13.259098] cgroup: cgroup2: unknown option "nsdelegate"
	[  +0.866691] IPv4: martian source 10.244.0.5 from 10.244.0.5, on dev vethbabe3094
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 5e 69 cf 9d 65 c0 08 06        ......^i..e...
	[Sep15 19:23] cgroup: cgroup2: unknown option "nsdelegate"
	
	* 
	* ==> etcd [68c751171dcd7d647b503ddd8a23729be4c80075be04f4911d2d09c0cd2ef1d6] <==
	* {"level":"warn","ts":"2021-09-15T19:23:02.791Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:01.794Z","time spent":"997.399319ms","remote":"127.0.0.1:38158","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":599,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" mod_revision:524 > success:<request_put:<key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" value_size:531 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" > >"}
	{"level":"info","ts":"2021-09-15T19:23:02.791Z","caller":"traceutil/trace.go:171","msg":"trace[1006913848] linearizableReadLoop","detail":"{readStateIndex:570; appliedIndex:569; }","duration":"2.591966237s","start":"2021-09-15T19:23:00.199Z","end":"2021-09-15T19:23:02.791Z","steps":["trace[1006913848] 'read index received'  (duration: 913.0891ms)","trace[1006913848] 'applied index is now lower than readState.Index'  (duration: 1.678875336s)"],"step_count":2}
	{"level":"warn","ts":"2021-09-15T19:23:02.791Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:22:59.852Z","time spent":"2.939831065s","remote":"127.0.0.1:38060","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1114,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" mod_revision:545 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" value_size:1041 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" > >"}
	{"level":"warn","ts":"2021-09-15T19:23:03.292Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":15638323004940351675,"retry-timeout":"500ms"}
	{"level":"warn","ts":"2021-09-15T19:23:03.792Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":15638323004940351675,"retry-timeout":"500ms"}
	{"level":"warn","ts":"2021-09-15T19:23:03.996Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.056444461s","expected-duration":"1s"}
	{"level":"info","ts":"2021-09-15T19:23:03.996Z","caller":"traceutil/trace.go:171","msg":"trace[994553924] linearizableReadLoop","detail":"{readStateIndex:571; appliedIndex:571; }","duration":"1.204874877s","start":"2021-09-15T19:23:02.791Z","end":"2021-09-15T19:23:03.996Z","steps":["trace[994553924] 'read index received'  (duration: 1.204854238s)","trace[994553924] 'applied index is now lower than readState.Index'  (duration: 18.873µs)"],"step_count":2}
	{"level":"warn","ts":"2021-09-15T19:23:03.997Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.792511814s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085\" ","response":"range_response_count:1 size:787"}
	{"level":"info","ts":"2021-09-15T19:23:03.997Z","caller":"traceutil/trace.go:171","msg":"trace[1998177799] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085; range_end:; response_count:1; response_revision:548; }","duration":"1.792595532s","start":"2021-09-15T19:23:02.205Z","end":"2021-09-15T19:23:03.997Z","steps":["trace[1998177799] 'agreement among raft nodes before linearized reading'  (duration: 1.791882626s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.997Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.204Z","time spent":"1.792678664s","remote":"127.0.0.1:38010","response type":"/etcdserverpb.KV/Range","request count":0,"request size":90,"response count":1,"response size":810,"request content":"key:\"/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.738122175s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[1177029980] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:548; }","duration":"1.738172063s","start":"2021-09-15T19:23:02.259Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[1177029980] 'agreement among raft nodes before linearized reading'  (duration: 1.736912592s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.259Z","time spent":"1.738230286s","remote":"127.0.0.1:38250","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":28,"request content":"key:\"/registry/health\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.493659597s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[2071497708] range","detail":"{range_begin:/registry/networkpolicies/; range_end:/registry/networkpolicies0; response_count:0; response_revision:548; }","duration":"1.493691663s","start":"2021-09-15T19:23:02.504Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[2071497708] 'agreement among raft nodes before linearized reading'  (duration: 1.492292928s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.504Z","time spent":"1.493733527s","remote":"127.0.0.1:38170","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":0,"response size":28,"request content":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.789357774s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"830.565162ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/default\" ","response":"range_response_count:1 size:343"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[1354754751] range","detail":"{range_begin:/registry/namespaces/default; range_end:; response_count:1; response_revision:548; }","duration":"830.609729ms","start":"2021-09-15T19:23:03.167Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[1354754751] 'agreement among raft nodes before linearized reading'  (duration: 828.900071ms)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:03.167Z","time spent":"830.664651ms","remote":"127.0.0.1:38054","response type":"/etcdserverpb.KV/Range","request count":0,"request size":30,"response count":1,"response size":366,"request content":"key:\"/registry/namespaces/default\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.827186779s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" ","response":"range_response_count:1 size:4936"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[554460785] range","detail":"{range_begin:/registry/minions/; range_end:/registry/minions0; response_count:1; response_revision:548; }","duration":"2.827248402s","start":"2021-09-15T19:23:01.171Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[554460785] 'agreement among raft nodes before linearized reading'  (duration: 2.825281977s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:01.171Z","time spent":"2.827299141s","remote":"127.0.0.1:38068","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":1,"response size":4959,"request content":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" "}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[483421495] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:548; }","duration":"1.789408028s","start":"2021-09-15T19:23:02.209Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[483421495] 'agreement among raft nodes before linearized reading'  (duration: 1.787721349s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.209Z","time spent":"1.78980824s","remote":"127.0.0.1:38250","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":28,"request content":"key:\"/registry/health\" "}
	
	* 
	* ==> kernel <==
	*  19:23:15 up  5:05,  0 users,  load average: 8.73, 4.63, 2.41
	Linux pause-20210915191717-498219 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.2 LTS"
	
	* 
	* ==> kube-apiserver [c59a5411d0a433dc24d4b92cbfe6897ccefe0c7791ebb38fa78a538f7451455a] <==
	* Trace[1935315716]: ---"Transaction committed" 2940ms (19:23:02.792)
	Trace[1935315716]: [2.941327631s] [2.941327631s] END
	I0915 19:23:02.792544       1 trace.go:205] Trace[160500084]: "GuaranteedUpdate etcd3" type:*coordination.Lease (15-Sep-2021 19:23:01.793) (total time: 999ms):
	Trace[160500084]: ---"Transaction committed" 998ms (19:23:02.792)
	Trace[160500084]: [999.103304ms] [999.103304ms] END
	I0915 19:23:02.792708       1 trace.go:205] Trace[83543991]: "Update" url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath,user-agent:storage-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:17b9dfd5-5501-45f7-b3cd-14cd9632e7f8,client:192.168.76.2,accept:application/json, */*,protocol:HTTP/2.0 (15-Sep-2021 19:22:59.850) (total time: 2941ms):
	Trace[83543991]: ---"Object stored in database" 2941ms (19:23:02.792)
	Trace[83543991]: [2.941792202s] [2.941792202s] END
	I0915 19:23:02.792810       1 trace.go:205] Trace[461359119]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210915191717-498219,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:3e3d5ee5-e1f3-456b-82ca-ded19898029f,client:192.168.76.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:23:01.793) (total time: 999ms):
	Trace[461359119]: ---"Object stored in database" 999ms (19:23:02.792)
	Trace[461359119]: [999.531575ms] [999.531575ms] END
	I0915 19:23:03.999781       1 trace.go:205] Trace[988981254]: "Get" url:/api/v1/namespaces/default,user-agent:kube-apiserver/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:a108ccf7-c083-4410-8746-c981a95f95e5,client:127.0.0.1,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (15-Sep-2021 19:23:03.167) (total time: 832ms):
	Trace[988981254]: ---"About to write a response" 832ms (19:23:03.999)
	Trace[988981254]: [832.240765ms] [832.240765ms] END
	I0915 19:23:04.000645       1 trace.go:205] Trace[1888490700]: "GuaranteedUpdate etcd3" type:*core.Event (15-Sep-2021 19:23:02.204) (total time: 1796ms):
	Trace[1888490700]: ---"initial value restored" 1794ms (19:23:03.998)
	Trace[1888490700]: [1.796117778s] [1.796117778s] END
	I0915 19:23:04.000797       1 trace.go:205] Trace[257925177]: "Patch" url:/api/v1/namespaces/kube-system/events/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:d6b68a1f-53de-45b4-957d-2071d61dd2f7,client:192.168.76.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:23:02.204) (total time: 1796ms):
	Trace[257925177]: ---"About to apply patch" 1794ms (19:23:03.998)
	Trace[257925177]: [1.796536176s] [1.796536176s] END
	I0915 19:23:04.001586       1 trace.go:205] Trace[607332746]: "List etcd3" key:/minions,resourceVersion:,resourceVersionMatch:,limit:0,continue: (15-Sep-2021 19:23:01.171) (total time: 2830ms):
	Trace[607332746]: [2.830446727s] [2.830446727s] END
	I0915 19:23:04.002006       1 trace.go:205] Trace[557314537]: "List" url:/api/v1/nodes,user-agent:kindnetd/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:daca3847-81a5-42d6-bc90-18e89e76e274,client:192.168.76.2,accept:application/json, */*,protocol:HTTP/2.0 (15-Sep-2021 19:23:01.171) (total time: 2830ms):
	Trace[557314537]: ---"Listing from storage done" 2830ms (19:23:04.001)
	Trace[557314537]: [2.830874436s] [2.830874436s] END
	
	* 
	* ==> kube-controller-manager [ffa7fe563436a7ae8d7cecd36b9ff38df2bcc5435d8942a21f17d65219db5c80] <==
	* I0915 19:21:56.621813       1 shared_informer.go:247] Caches are synced for GC 
	I0915 19:21:56.666633       1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring 
	I0915 19:21:56.737104       1 shared_informer.go:247] Caches are synced for HPA 
	I0915 19:21:56.771555       1 shared_informer.go:247] Caches are synced for TTL after finished 
	I0915 19:21:56.776318       1 shared_informer.go:247] Caches are synced for resource quota 
	I0915 19:21:56.786816       1 shared_informer.go:247] Caches are synced for bootstrap_signer 
	I0915 19:21:56.814494       1 shared_informer.go:247] Caches are synced for cronjob 
	I0915 19:21:56.815608       1 shared_informer.go:247] Caches are synced for job 
	I0915 19:21:56.816836       1 shared_informer.go:247] Caches are synced for resource quota 
	I0915 19:21:56.849367       1 shared_informer.go:247] Caches are synced for crt configmap 
	I0915 19:21:57.069440       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"
	I0915 19:21:57.245086       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0915 19:21:57.258419       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0915 19:21:57.258447       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0915 19:21:57.424897       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-m5zrb"
	I0915 19:21:57.426662       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-x78hq"
	I0915 19:21:57.620526       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-2cj9r"
	I0915 19:21:57.626422       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-87x4l"
	I0915 19:21:57.831742       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"
	I0915 19:21:57.850742       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-2cj9r"
	I0915 19:22:21.597081       1 node_lifecycle_controller.go:1191] Controller detected that some Nodes are Ready. Exiting master disruption mode.
	W0915 19:22:30.529868       1 endpointslice_controller.go:306] Error syncing endpoint slices for service "kube-system/kube-dns", retrying. Error: failed to update kube-dns-bdr96 EndpointSlice for Service kube-system/kube-dns: etcdserver: request timed out
	I0915 19:22:30.529995       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Service" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpointSlices" message="Error updating Endpoint Slices for Service kube-system/kube-dns: failed to update kube-dns-bdr96 EndpointSlice for Service kube-system/kube-dns: etcdserver: request timed out"
	I0915 19:22:30.535845       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint kube-system/kube-dns: etcdserver: request timed out"
	I0915 19:22:31.128758       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint kube-system/kube-dns: Operation cannot be fulfilled on endpoints \"kube-dns\": the object has been modified; please apply your changes to the latest version and try again"
	
	* 
	* ==> kube-proxy [0f8eb1bcec3c031e531b43c748eea2d33912cf7d55db49e7ea71778813c0c49d] <==
	* I0915 19:22:00.149349       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I0915 19:22:00.149412       1 server_others.go:140] Detected node IP 192.168.76.2
	W0915 19:22:00.149443       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy
	I0915 19:22:00.224185       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary
	I0915 19:22:00.224227       1 server_others.go:212] Using iptables Proxier.
	I0915 19:22:00.224243       1 server_others.go:219] creating dualStackProxier for iptables.
	W0915 19:22:00.224268       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
	I0915 19:22:00.224633       1 server.go:649] Version: v1.22.1
	I0915 19:22:00.225573       1 config.go:315] Starting service config controller
	I0915 19:22:00.225594       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0915 19:22:00.225648       1 config.go:224] Starting endpoint slice config controller
	I0915 19:22:00.225654       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	E0915 19:22:00.237347       1 event_broadcaster.go:253] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pause-20210915191717-498219.16a5152c5a0d5dba", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, EventTime:v1.MicroTime{Time:time.Time{wall:0xc048afd60d6ce200, ext:146529520, loc:(*time.Location)(0x2d81340)}}, Series:(*v1.EventSeries)(nil), ReportingController:"kube-proxy", ReportingInstance:"kube-proxy-pause-20210915191717-498219", Action:"StartKubeProxy", Reason:"Starting", Regarding:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"pause
-20210915191717-498219", UID:"pause-20210915191717-498219", APIVersion:"", ResourceVersion:"", FieldPath:""}, Related:(*v1.ObjectReference)(nil), Note:"", Type:"Normal", DeprecatedSource:v1.EventSource{Component:"", Host:""}, DeprecatedFirstTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedLastTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedCount:0}': 'Event "pause-20210915191717-498219.16a5152c5a0d5dba" is invalid: involvedObject.namespace: Invalid value: "": does not match event.namespace' (will not retry!)
	I0915 19:22:00.326477       1 shared_informer.go:247] Caches are synced for service config 
	I0915 19:22:00.326476       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	
	* 
	* ==> kube-scheduler [f9a6017a48e430457074558a4f8587452f4bc9da312b0a267d9b4c66ec6698a3] <==
	* E0915 19:21:41.760210       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0915 19:21:41.760303       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0915 19:21:41.760377       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0915 19:21:41.760448       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0915 19:21:41.761375       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:41.761567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0915 19:21:41.761758       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0915 19:21:41.761874       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0915 19:21:41.762011       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0915 19:21:41.762094       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:41.762150       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0915 19:21:41.762299       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0915 19:21:42.633569       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:42.633572       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:42.656483       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0915 19:21:42.750028       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0915 19:21:42.834567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0915 19:21:42.847835       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0915 19:21:42.905891       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0915 19:21:42.913872       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0915 19:21:44.504439       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.560422       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.562990       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.565584       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	I0915 19:21:45.957351       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Wed 2021-09-15 19:20:45 UTC, end at Wed 2021-09-15 19:23:15 UTC. --
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466612    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/78449e93-ea1e-46cd-92ca-d416ecbee251-xtables-lock\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466634    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-cni-cfg\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466653    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-xtables-lock\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466668    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-lib-modules\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466731    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78449e93-ea1e-46cd-92ca-d416ecbee251-lib-modules\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466791    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wcrs\" (UniqueName: \"kubernetes.io/projected/78449e93-ea1e-46cd-92ca-d416ecbee251-kube-api-access-2wcrs\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466837    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdpn4\" (UniqueName: \"kubernetes.io/projected/b75f582d-6b59-4a29-8f66-5670fc372ef7-kube-api-access-cdpn4\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:22:00 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:00.444629    1889 kubelet.go:2332] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:19.178108    1889 event.go:264] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-pause-20210915191717-498219", UID:"7711ec5bdcd091468467911b3afef6b2", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"Unhealthy", Message:"Readiness
probe failed: HTTP probe failed with statuscode: 500", Source:v1.EventSource{Component:"kubelet", Host:"pause-20210915191717-498219"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc048afd909eda885, ext:27550152024, loc:(*time.Location)(0x55f11597a660)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc048afd909eda885, ext:27550152024, loc:(*time.Location)(0x55f11597a660)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'etcdserver: request timed out' (will not retry!)
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.742011    1889 topology_manager.go:200] "Topology Admit Handler"
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.807643    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bacedd06-5f04-410d-bb77-6d7082ac74d8-config-volume\") pod \"coredns-78fcd69978-87x4l\" (UID: \"bacedd06-5f04-410d-bb77-6d7082ac74d8\") "
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.807946    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrzf5\" (UniqueName: \"kubernetes.io/projected/bacedd06-5f04-410d-bb77-6d7082ac74d8-kube-api-access-mrzf5\") pod \"coredns-78fcd69978-87x4l\" (UID: \"bacedd06-5f04-410d-bb77-6d7082ac74d8\") "
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: W0915 19:22:39.201764    1889 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: W0915 19:22:39.201764    1889 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251093    1889 remote_runtime.go:207] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\"" filter="&PodSandboxFilter{Id:,State:&PodSandboxStateValue{State:SANDBOX_READY,},LabelSelector:map[string]string{},}"
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251148    1889 kuberuntime_sandbox.go:281] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251163    1889 kubelet_pods.go:1117] "Error listing containers" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251179    1889 kubelet.go:2143] "Failed cleaning pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.322958    1889 remote_runtime.go:207] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\"" filter="nil"
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.323017    1889 kuberuntime_sandbox.go:281] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.323041    1889 generic.go:205] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.752088    1889 remote_runtime.go:86] "Version from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.700577    1889 topology_manager.go:200] "Topology Admit Handler"
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.739217    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/b89fc9f6-92a3-4764-a891-43683f852797-tmp\") pod \"storage-provisioner\" (UID: \"b89fc9f6-92a3-4764-a891-43683f852797\") "
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.739305    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnnvv\" (UniqueName: \"kubernetes.io/projected/b89fc9f6-92a3-4764-a891-43683f852797-kube-api-access-mnnvv\") pod \"storage-provisioner\" (UID: \"b89fc9f6-92a3-4764-a891-43683f852797\") "
	
	* 
	* ==> storage-provisioner [8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de] <==
	* I0915 19:22:52.434096       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0915 19:22:52.442402       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0915 19:22:52.442449       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0915 19:22:52.449631       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0915 19:22:52.449779       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554!
	I0915 19:22:52.449737       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"edcec5d9-3929-420f-ac85-43ebcaef7c79", APIVersion:"v1", ResourceVersion:"540", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554 became leader
	I0915 19:22:52.550239       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554!
	

                                                
                                                
-- /stdout --
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20210915191717-498219 -n pause-20210915191717-498219
helpers_test.go:262: (dbg) Run:  kubectl --context pause-20210915191717-498219 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:271: non-running pods: 
helpers_test.go:273: ======> post-mortem[TestPause/serial/PauseAgain]: describe non-running pods <======
helpers_test.go:276: (dbg) Run:  kubectl --context pause-20210915191717-498219 describe pod 
helpers_test.go:276: (dbg) Non-zero exit: kubectl --context pause-20210915191717-498219 describe pod : exit status 1 (64.264541ms)

                                                
                                                
** stderr ** 
	error: resource name may not be empty

                                                
                                                
** /stderr **
helpers_test.go:278: kubectl --context pause-20210915191717-498219 describe pod : exit status 1
helpers_test.go:223: -----------------------post-mortem--------------------------------
helpers_test.go:231: ======>  post-mortem[TestPause/serial/PauseAgain]: docker inspect <======
helpers_test.go:232: (dbg) Run:  docker inspect pause-20210915191717-498219
helpers_test.go:236: (dbg) docker inspect pause-20210915191717-498219:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74",
	        "Created": "2021-09-15T19:20:44.739194513Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 639632,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2021-09-15T19:20:45.450816177Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:83b5a81388468b1ffcd3874b4f24c1406c63c33ac07797cc8bed6ad0207d36a8",
	        "ResolvConfPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/hostname",
	        "HostsPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/hosts",
	        "LogPath": "/var/lib/docker/containers/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74/475715a3ea2c70c871f5a14e68dced09342fe170debb61697c4070e1325bbb74-json.log",
	        "Name": "/pause-20210915191717-498219",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "pause-20210915191717-498219:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "pause-20210915191717-498219",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "CapAdd": null,
	            "CapDrop": null,
	            "Capabilities": null,
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 0,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": null,
	            "BlkioDeviceWriteBps": null,
	            "BlkioDeviceReadIOps": null,
	            "BlkioDeviceWriteIOps": null,
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [
	                {
	                    "PathOnHost": "/dev/fuse",
	                    "PathInContainer": "/dev/fuse",
	                    "CgroupPermissions": "rwm"
	                }
	            ],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "KernelMemory": 0,
	            "KernelMemoryTCP": 0,
	            "MemoryReservation": 0,
	            "MemorySwap": 0,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e-init/diff:/var/lib/docker/overlay2/0f8a10c746fedd8d666b9dae9bdd481a4ecb3bdc1c19c1763f5067cb6f6ec480/diff:/var/lib/docker/overlay2/f54dd51211f7fd37ed9e7e1b70117531d83c45068e0d908bb274324aaab9559e/diff:/var/lib/docker/overlay2/db8bcdf3259b37def0e8daacd8a4b91582e91b1335c4898bead8f0570ee379f4/diff:/var/lib/docker/overlay2/38faf25fee6b5c923ea643302bba2da4194356f1ecd1442a2371c90afb025b10/diff:/var/lib/docker/overlay2/c4a1a3e49e5edffd417be1158a98868c52bdfc84e62524f2c795e427d987e984/diff:/var/lib/docker/overlay2/e68c2d7fd8912bc6f5e5c4fd63053076de99a4d27b5ac2d087e97b170c724fbd/diff:/var/lib/docker/overlay2/c74734152182eae7a2408058cc612acaac307696039525cbf809638bdc5f0291/diff:/var/lib/docker/overlay2/871cb5ebce097dd4aeeed897eae2f2516c492acd2cf20e22a9bd621400d03fab/diff:/var/lib/docker/overlay2/c6de31e81e924f091a3674cc807ae856aaaf0bd75eede35b8012e555a78482f8/diff:/var/lib/docker/overlay2/5cb89b
dcb371bd4714cf4cc592534e708077fc8ba74ac5611767920d2e72b515/diff:/var/lib/docker/overlay2/855cba59b338da688aa696b251e03ec2f0d9dc95537b26265f31042b64dbcc2d/diff:/var/lib/docker/overlay2/68e4b369a0e1b1a42b5b9874ee9fa0849598643096f78bd2ff9f86e7f0dee281/diff:/var/lib/docker/overlay2/7d9c9be2ec55a3cfaeb8e493bde1f09d3e07500aa41b31d9dc92e3a045bfaa88/diff:/var/lib/docker/overlay2/e229f9da50c177e6addfce418c74667438f518d5821a0f714cb58a3968830c71/diff:/var/lib/docker/overlay2/ef41fa20aaf0f3e8b0f0873abea368bc5dfaf6684783ca409e3d6dfa74ca2b33/diff:/var/lib/docker/overlay2/8160677224d3d0ba75ceac5e22adbe4420f58aa9df575a4fa1eb16cfa5d36cb1/diff:/var/lib/docker/overlay2/747c3fc9ab1ea2616d662bd3b2e2f1ddbdac907a6eea86ac017e9ce3e66dc4d9/diff:/var/lib/docker/overlay2/f8eb124418298912c3691320300767eabaeae37f352f56c2d0e5a40dd97b0bc2/diff:/var/lib/docker/overlay2/c37f4c78c3026a8785fb4aca9fa78dc5ac21307cb3bfbf746bacec078e037770/diff:/var/lib/docker/overlay2/ee71c4960738cdf41b558b5aa16215f18299ecf0b241560a77477f080674ba8c/diff:/var/lib/d
ocker/overlay2/f2132a0cc49a4383ce675ba6870120bd2c58077afad82ab90d066c0651128e1d/diff:/var/lib/docker/overlay2/44200c5ed83b044737127b23b0b15c55e21152acc08ba98910e0dcb93835c4d5/diff:/var/lib/docker/overlay2/22bce5e99989e32cb7a1f876e412e03427623b5cb70e4709d0336c2cae5f4b37/diff:/var/lib/docker/overlay2/ccfb925585c3768c7aba8e731873849181bedce4d441b3095c1abfd310c405e1/diff:/var/lib/docker/overlay2/a90553cf4067ab91ee5ed23daf5f3aab785ded168917688d3c11e7eb856cc869/diff:/var/lib/docker/overlay2/dc493bca572baf2fff7143d6c551dc24acb22082e51a68200466da7510d37550/diff:/var/lib/docker/overlay2/e4fdd0a7dd5c09a7507c2e66bb44972d2db20fd3c58d2191eaa45291e1a47321/diff:/var/lib/docker/overlay2/4badf8f702a906675401fab2bb8327dafc5e0098b8a40e8ae31d3f4337c5539e/diff:/var/lib/docker/overlay2/d7a568f51d57ee1283764757ae3c91db612a7acb01906d88f7321359f27d4dcb/diff:/var/lib/docker/overlay2/123e8c40e6520b691981a6af80c211632618f36cb297ef8a28376985e8b9eddf/diff:/var/lib/docker/overlay2/fcfefbd58c332906200403538c8d881d31cbd97ecd5a2e223b198713731
51469/diff:/var/lib/docker/overlay2/a9e5b72b4ba31d329ac284cad558db42f24197775aaabfd188f2846a0a4ce96d/diff:/var/lib/docker/overlay2/7916e1ed717fc8628e14637400ba911d6e64209e501841613f69224c999b54f8/diff:/var/lib/docker/overlay2/3c121fd6f387f06c1b3a211eb1d7db64ffd333a873146a734de241e936ab5322/diff:/var/lib/docker/overlay2/9958539b4278fcc1c310de22689891aba5f238a94351d3c645b9dacba922241b/diff:/var/lib/docker/overlay2/c6c60f0d02b1e1aad2ea4fa1fb017d98e1ca4602689452dbd721342c0927fc6a/diff:/var/lib/docker/overlay2/e61aabb9eb2161801d4795e4a00f41afd54c504a52aeeef70d49d2a4f47fcd99/diff:/var/lib/docker/overlay2/a69e80d9160e6158cf9f37881d60928bf3221341b1fffe8d2855488233278102/diff:/var/lib/docker/overlay2/f76fd1ba3588d22f5228ab597df7a62e20a79217c1712dbc33e20061e12891c6/diff",
	                "MergedDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/merged",
	                "UpperDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/diff",
	                "WorkDir": "/var/lib/docker/overlay2/71fa8785763f7b9e8ad5517686ab55d29751d16363cb870572b6a587d8cafe8e/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "pause-20210915191717-498219",
	                "Source": "/var/lib/docker/volumes/pause-20210915191717-498219/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "pause-20210915191717-498219",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "pause-20210915191717-498219",
	                "name.minikube.sigs.k8s.io": "pause-20210915191717-498219",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "27118836b403ba46eaa0c5f84b51105679f32ab8d48b0cf3d1809c92f7eab313",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33158"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33156"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33153"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33155"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33154"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/27118836b403",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "pause-20210915191717-498219": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.76.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "475715a3ea2c"
	                    ],
	                    "NetworkID": "b9847da4d513dbef2974381ee64c2c1cc6dd8d925ac1a45cdcc366eac6d6da5c",
	                    "EndpointID": "fdae2a292c54522fc39bfc656e4fce6fd18fc8d9526f059c210503a13a336d70",
	                    "Gateway": "192.168.76.1",
	                    "IPAddress": "192.168.76.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:4c:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210915191717-498219 -n pause-20210915191717-498219
helpers_test.go:245: <<< TestPause/serial/PauseAgain FAILED: start of post-mortem logs <<<
helpers_test.go:246: ======>  post-mortem[TestPause/serial/PauseAgain]: minikube logs <======
helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20210915191717-498219 logs -n 25
helpers_test.go:253: TestPause/serial/PauseAgain logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	| Command |                    Args                    |                  Profile                   |  User   | Version |          Start Time           |           End Time            |
	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	| stop    | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:31 UTC | Wed, 15 Sep 2021 19:16:56 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	|         | --schedule 5s                              |                                            |         |         |                               |                               |
	| delete  | -p                                         | scheduled-stop-20210915191532-498219       | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:16:58 UTC | Wed, 15 Sep 2021 19:17:03 UTC |
	|         | scheduled-stop-20210915191532-498219       |                                            |         |         |                               |                               |
	| delete  | -p                                         | insufficient-storage-20210915191703-498219 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:11 UTC | Wed, 15 Sep 2021 19:17:17 UTC |
	|         | insufficient-storage-20210915191703-498219 |                                            |         |         |                               |                               |
	| delete  | -p                                         | kubenet-20210915191717-498219              | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:17:17 UTC |
	|         | kubenet-20210915191717-498219              |                                            |         |         |                               |                               |
	| delete  | -p                                         | flannel-20210915191717-498219              | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:17:18 UTC |
	|         | flannel-20210915191717-498219              |                                            |         |         |                               |                               |
	| delete  | -p false-20210915191718-498219             | false-20210915191718-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:18 UTC | Wed, 15 Sep 2021 19:17:19 UTC |
	| start   | -p                                         | missing-upgrade-20210915191719-498219      | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:18:43 UTC | Wed, 15 Sep 2021 19:19:26 UTC |
	|         | missing-upgrade-20210915191719-498219      |                                            |         |         |                               |                               |
	|         | --memory=2200 --alsologtostderr            |                                            |         |         |                               |                               |
	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | missing-upgrade-20210915191719-498219      | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:19:26 UTC | Wed, 15 Sep 2021 19:19:29 UTC |
	|         | missing-upgrade-20210915191719-498219      |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:19:29 UTC | Wed, 15 Sep 2021 19:20:14 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.14.0               |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| stop    | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:20:14 UTC | Wed, 15 Sep 2021 19:20:35 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	| start   | -p                                         | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:21:46 UTC |
	|         | force-systemd-env-20210915191717-498219    |                                            |         |         |                               |                               |
	|         | --memory=2048 --alsologtostderr            |                                            |         |         |                               |                               |
	|         | -v=5 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| -p      | force-systemd-env-20210915191717-498219    | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:46 UTC | Wed, 15 Sep 2021 19:21:46 UTC |
	|         | ssh cat /etc/containerd/config.toml        |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:20:35 UTC | Wed, 15 Sep 2021 19:21:48 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.22.2-rc.0          |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | force-systemd-env-20210915191717-498219    | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:46 UTC | Wed, 15 Sep 2021 19:21:50 UTC |
	|         | force-systemd-env-20210915191717-498219    |                                            |         |         |                               |                               |
	| start   | -p                                         | offline-containerd-20210915191717-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:21:56 UTC |
	|         | offline-containerd-20210915191717-498219   |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --memory=2048       |                                            |         |         |                               |                               |
	|         | --wait=true --driver=docker                |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| delete  | -p                                         | offline-containerd-20210915191717-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:56 UTC | Wed, 15 Sep 2021 19:22:01 UTC |
	|         | offline-containerd-20210915191717-498219   |                                            |         |         |                               |                               |
	| start   | -p pause-20210915191717-498219             | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:17:17 UTC | Wed, 15 Sep 2021 19:22:36 UTC |
	|         | --memory=2048                              |                                            |         |         |                               |                               |
	|         | --install-addons=false                     |                                            |         |         |                               |                               |
	|         | --wait=all --driver=docker                 |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| start   | -p pause-20210915191717-498219             | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:22:37 UTC | Wed, 15 Sep 2021 19:22:53 UTC |
	|         | --alsologtostderr                          |                                            |         |         |                               |                               |
	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| start   | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:21:48 UTC | Wed, 15 Sep 2021 19:22:53 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	|         | --memory=2200                              |                                            |         |         |                               |                               |
	|         | --kubernetes-version=v1.22.2-rc.0          |                                            |         |         |                               |                               |
	|         | --alsologtostderr -v=1 --driver=docker     |                                            |         |         |                               |                               |
	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |
	| -p      | pause-20210915191717-498219                | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:23:04 UTC | Wed, 15 Sep 2021 19:23:05 UTC |
	|         | logs -n 25                                 |                                            |         |         |                               |                               |
	| delete  | -p                                         | kubernetes-upgrade-20210915191929-498219   | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:22:53 UTC | Wed, 15 Sep 2021 19:23:05 UTC |
	|         | kubernetes-upgrade-20210915191929-498219   |                                            |         |         |                               |                               |
	| -p      | pause-20210915191717-498219                | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:23:06 UTC | Wed, 15 Sep 2021 19:23:07 UTC |
	|         | logs -n 25                                 |                                            |         |         |                               |                               |
	| -p      | pause-20210915191717-498219                | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:23:09 UTC | Wed, 15 Sep 2021 19:23:10 UTC |
	|         | logs -n 25                                 |                                            |         |         |                               |                               |
	| unpause | -p pause-20210915191717-498219             | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:23:11 UTC | Wed, 15 Sep 2021 19:23:11 UTC |
	|         | --alsologtostderr -v=5                     |                                            |         |         |                               |                               |
	| -p      | pause-20210915191717-498219                | pause-20210915191717-498219                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:23:14 UTC | Wed, 15 Sep 2021 19:23:15 UTC |
	|         | logs -n 25                                 |                                            |         |         |                               |                               |
	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2021/09/15 19:23:08
	Running on machine: debian-jenkins-agent-1
	Binary: Built with gc go1.17 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0915 19:23:08.338662  661434 out.go:298] Setting OutFile to fd 1 ...
	I0915 19:23:08.338901  661434 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:23:08.338919  661434 out.go:311] Setting ErrFile to fd 2...
	I0915 19:23:08.338925  661434 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:23:08.339071  661434 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	I0915 19:23:08.339454  661434 out.go:305] Setting JSON to false
	I0915 19:23:08.387952  661434 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-1","uptime":18346,"bootTime":1631715442,"procs":262,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}
	I0915 19:23:08.388120  661434 start.go:121] virtualization: kvm guest
	I0915 19:23:08.391808  661434 out.go:177] * [force-systemd-flag-20210915192308-498219] minikube v1.23.0 on Debian 9.13 (kvm/amd64)
	I0915 19:23:08.393454  661434 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	I0915 19:23:08.391997  661434 notify.go:169] Checking for updates...
	I0915 19:23:08.395035  661434 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0915 19:23:08.396410  661434 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube
	I0915 19:23:08.397936  661434 out.go:177]   - MINIKUBE_LOCATION=12425
	I0915 19:23:08.398603  661434 config.go:177] Loaded profile config "pause-20210915191717-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 19:23:08.398733  661434 config.go:177] Loaded profile config "running-upgrade-20210915192201-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0915 19:23:08.398834  661434 config.go:177] Loaded profile config "stopped-upgrade-20210915192150-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0915 19:23:08.398895  661434 driver.go:343] Setting default libvirt URI to qemu:///system
	I0915 19:23:08.457674  661434 docker.go:132] docker version: linux-19.03.15
	I0915 19:23:08.457812  661434 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 19:23:08.568631  661434 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:45 OomKillDisable:true NGoroutines:53 SystemTime:2021-09-15 19:23:08.507692821 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 19:23:08.568742  661434 docker.go:237] overlay module found
	I0915 19:23:08.571138  661434 out.go:177] * Using the docker driver based on user configuration
	I0915 19:23:08.571167  661434 start.go:278] selected driver: docker
	I0915 19:23:08.571175  661434 start.go:751] validating driver "docker" against <nil>
	I0915 19:23:08.571201  661434 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
	W0915 19:23:08.571250  661434 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.
	W0915 19:23:08.571286  661434 out.go:242] ! Your cgroup does not allow setting memory.
	I0915 19:23:08.572861  661434 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities
	I0915 19:23:08.573992  661434 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 19:23:08.699784  661434 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:45 OomKillDisable:true NGoroutines:53 SystemTime:2021-09-15 19:23:08.619158282 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 19:23:08.699903  661434 start_flags.go:264] no existing cluster config was found, will generate one from the flags 
	I0915 19:23:08.700084  661434 start_flags.go:719] Wait components to verify : map[apiserver:true system_pods:true]
	I0915 19:23:08.700108  661434 cni.go:93] Creating CNI manager for ""
	I0915 19:23:08.700120  661434 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet
	I0915 19:23:08.700133  661434 cni.go:217] auto-setting extra-config to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0915 19:23:08.700143  661434 cni.go:222] extra-config set to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0915 19:23:08.700148  661434 start_flags.go:273] Found "CNI" CNI - setting NetworkPlugin=cni
	I0915 19:23:08.700160  661434 start_flags.go:278] config:
	{Name:force-systemd-flag-20210915192308-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:force-systemd-flag-20210915192308-498219 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:c
luster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 19:23:08.702638  661434 out.go:177] * Starting control plane node force-systemd-flag-20210915192308-498219 in cluster force-systemd-flag-20210915192308-498219
	I0915 19:23:08.702676  661434 cache.go:118] Beginning downloading kic base image for docker with containerd
	I0915 19:23:08.704136  661434 out.go:177] * Pulling base image ...
	I0915 19:23:08.704174  661434 preload.go:131] Checking if preload exists for k8s version v1.22.1 and runtime containerd
	I0915 19:23:08.704217  661434 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4
	I0915 19:23:08.704218  661434 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon
	I0915 19:23:08.704232  661434 cache.go:57] Caching tarball of preloaded images
	I0915 19:23:08.704410  661434 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0915 19:23:08.704429  661434 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.1 on containerd
	I0915 19:23:08.704552  661434 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/force-systemd-flag-20210915192308-498219/config.json ...
	I0915 19:23:08.704582  661434 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/force-systemd-flag-20210915192308-498219/config.json: {Name:mka76c844874e21b876099e093ac1643da3f90ce Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0915 19:23:08.850760  661434 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull
	I0915 19:23:08.850795  661434 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load
	I0915 19:23:08.850814  661434 cache.go:206] Successfully downloaded all kic artifacts
	I0915 19:23:08.850870  661434 start.go:313] acquiring machines lock for force-systemd-flag-20210915192308-498219: {Name:mkc32223430342e18ab7395f1cdbdb2ec6fb46f1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0915 19:23:08.851014  661434 start.go:317] acquired machines lock for "force-systemd-flag-20210915192308-498219" in 121.212µs
	I0915 19:23:08.851045  661434 start.go:89] Provisioning new machine with config: &{Name:force-systemd-flag-20210915192308-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:force-systemd-flag-20210915192308-498219 Namesp
ace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0} &{Name: IP: Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}
	I0915 19:23:08.851150  661434 start.go:126] createHost starting for "" (driver="docker")
	I0915 19:23:05.935263  660452 out.go:177] * Updating the running docker "running-upgrade-20210915192201-498219" container ...
	I0915 19:23:05.935309  660452 machine.go:88] provisioning docker machine ...
	I0915 19:23:05.935363  660452 ubuntu.go:169] provisioning hostname "running-upgrade-20210915192201-498219"
	I0915 19:23:05.935446  660452 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20210915192201-498219
	I0915 19:23:05.983549  660452 main.go:130] libmachine: Using SSH client type: native
	I0915 19:23:05.983775  660452 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33166 <nil> <nil>}
	I0915 19:23:05.983792  660452 main.go:130] libmachine: About to run SSH command:
	sudo hostname running-upgrade-20210915192201-498219 && echo "running-upgrade-20210915192201-498219" | sudo tee /etc/hostname
	I0915 19:23:06.124999  660452 main.go:130] libmachine: SSH cmd err, output: <nil>: running-upgrade-20210915192201-498219
	
	I0915 19:23:06.125085  660452 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20210915192201-498219
	I0915 19:23:06.172168  660452 main.go:130] libmachine: Using SSH client type: native
	I0915 19:23:06.172390  660452 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33166 <nil> <nil>}
	I0915 19:23:06.172418  660452 main.go:130] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\srunning-upgrade-20210915192201-498219' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 running-upgrade-20210915192201-498219/g' /etc/hosts;
				else 
					echo '127.0.1.1 running-upgrade-20210915192201-498219' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0915 19:23:06.262803  660452 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0
	I0915 19:23:06.263391  660452 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0
	I0915 19:23:06.264934  660452 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0
	I0915 19:23:06.275653  660452 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0
	I0915 19:23:06.311391  660452 main.go:130] libmachine: SSH cmd err, output: <nil>: 
	I0915 19:23:06.311429  660452 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157
/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube}
	I0915 19:23:06.313670  660452 ubuntu.go:177] setting up certificates
	I0915 19:23:06.313691  660452 provision.go:83] configureAuth start
	I0915 19:23:06.313766  660452 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" running-upgrade-20210915192201-498219
	I0915 19:23:06.375431  660452 provision.go:138] copyHostCerts
	I0915 19:23:06.375502  660452 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem, removing ...
	I0915 19:23:06.375513  660452 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem
	I0915 19:23:06.375580  660452 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem (1082 bytes)
	I0915 19:23:06.375670  660452 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem, removing ...
	I0915 19:23:06.375686  660452 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem
	I0915 19:23:06.375714  660452 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem (1123 bytes)
	I0915 19:23:06.375777  660452 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem, removing ...
	I0915 19:23:06.375790  660452 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem
	I0915 19:23:06.375815  660452 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem (1679 bytes)
	I0915 19:23:06.375863  660452 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem org=jenkins.running-upgrade-20210915192201-498219 san=[192.168.59.44 127.0.0.1 localhost 127.0.0.1 minikube running-upgrade-20210915192201-498219]
	I0915 19:23:06.386068  660452 image.go:177] found k8s.gcr.io/coredns:1.7.0 locally: &{UncompressedImageCore:0xc00061a230 lock:{state:0 sema:0} manifest:<nil>}
	I0915 19:23:06.386116  660452 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0
	I0915 19:23:06.485139  660452 provision.go:172] copyRemoteCerts
	I0915 19:23:06.485199  660452 ssh_runner.go:152] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0915 19:23:06.485249  660452 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20210915192201-498219
	I0915 19:23:06.552719  660452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33166 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/running-upgrade-20210915192201-498219/id_rsa Username:docker}
	I0915 19:23:06.658412  660452 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0915 19:23:06.682299  660452 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem --> /etc/docker/server.pem (1281 bytes)
	I0915 19:23:06.704998  660452 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0915 19:23:06.727508  660452 provision.go:86] duration metric: configureAuth took 413.801984ms
	I0915 19:23:06.727533  660452 ubuntu.go:193] setting minikube options for container-runtime
	I0915 19:23:06.727747  660452 config.go:177] Loaded profile config "running-upgrade-20210915192201-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0915 19:23:06.727762  660452 machine.go:91] provisioned docker machine in 792.445117ms
	I0915 19:23:06.727775  660452 start.go:267] post-start starting for "running-upgrade-20210915192201-498219" (driver="docker")
	I0915 19:23:06.727782  660452 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0915 19:23:06.727852  660452 ssh_runner.go:152] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0915 19:23:06.727893  660452 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20210915192201-498219
	I0915 19:23:06.810381  660452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33166 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/running-upgrade-20210915192201-498219/id_rsa Username:docker}
	I0915 19:23:06.897094  660452 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 exists
	I0915 19:23:06.897144  660452 cache.go:97] cache image "k8s.gcr.io/kube-controller-manager:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0" took 1.071734678s
	I0915 19:23:06.897164  660452 cache.go:81] save to tar file k8s.gcr.io/kube-controller-manager:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 succeeded
	I0915 19:23:06.917655  660452 ssh_runner.go:152] Run: cat /etc/os-release
	I0915 19:23:06.920667  660452 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0915 19:23:06.920693  660452 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0915 19:23:06.920717  660452 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0915 19:23:06.920728  660452 info.go:137] Remote host: Ubuntu 20.04.1 LTS
	I0915 19:23:06.920742  660452 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/addons for local assets ...
	I0915 19:23:06.920808  660452 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files for local assets ...
	I0915 19:23:06.920904  660452 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/4982192.pem -> 4982192.pem in /etc/ssl/certs
	I0915 19:23:06.921010  660452 ssh_runner.go:152] Run: sudo mkdir -p /etc/ssl/certs
	I0915 19:23:06.929384  660452 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/4982192.pem --> /etc/ssl/certs/4982192.pem (1708 bytes)
	I0915 19:23:06.951612  660452 start.go:270] post-start completed in 223.816314ms
	I0915 19:23:06.951688  660452 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0915 19:23:06.951729  660452 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20210915192201-498219
	I0915 19:23:07.025595  660452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33166 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/running-upgrade-20210915192201-498219/id_rsa Username:docker}
	I0915 19:23:07.044997  660452 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 exists
	I0915 19:23:07.045041  660452 cache.go:97] cache image "k8s.gcr.io/kube-scheduler:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0" took 1.219788608s
	I0915 19:23:07.045059  660452 cache.go:81] save to tar file k8s.gcr.io/kube-scheduler:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 succeeded
	I0915 19:23:07.123563  660452 fix.go:57] fixHost completed within 1.241807938s
	I0915 19:23:07.123592  660452 start.go:80] releasing machines lock for "running-upgrade-20210915192201-498219", held for 1.24186144s
	I0915 19:23:07.123675  660452 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" running-upgrade-20210915192201-498219
	I0915 19:23:07.174373  660452 ssh_runner.go:152] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0915 19:23:07.174441  660452 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20210915192201-498219
	I0915 19:23:07.229942  660452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33166 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/running-upgrade-20210915192201-498219/id_rsa Username:docker}
	I0915 19:23:07.389156  660452 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 exists
	I0915 19:23:07.389202  660452 cache.go:97] cache image "k8s.gcr.io/kube-apiserver:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0" took 1.56395339s
	I0915 19:23:07.389219  660452 cache.go:81] save to tar file k8s.gcr.io/kube-apiserver:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 succeeded
	I0915 19:23:07.430593  660452 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 exists
	I0915 19:23:07.430634  660452 cache.go:97] cache image "k8s.gcr.io/kube-proxy:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0" took 1.605315393s
	I0915 19:23:07.430649  660452 cache.go:81] save to tar file k8s.gcr.io/kube-proxy:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 succeeded
	I0915 19:23:08.951622  660452 image.go:177] found k8s.gcr.io/etcd:3.4.13-0 locally: &{UncompressedImageCore:0xc00061a040 lock:{state:0 sema:0} manifest:<nil>}
	I0915 19:23:08.951727  660452 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0
	I0915 19:23:09.083629  660452 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 exists
	I0915 19:23:09.083676  660452 cache.go:97] cache image "k8s.gcr.io/coredns:1.7.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0" took 3.25835954s
	I0915 19:23:09.083698  660452 cache.go:81] save to tar file k8s.gcr.io/coredns:1.7.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 succeeded
	I0915 19:23:08.853424  661434 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...
	I0915 19:23:08.853720  661434 start.go:160] libmachine.API.Create for "force-systemd-flag-20210915192308-498219" (driver="docker")
	I0915 19:23:08.853759  661434 client.go:168] LocalClient.Create starting
	I0915 19:23:08.853884  661434 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem
	I0915 19:23:08.853925  661434 main.go:130] libmachine: Decoding PEM data...
	I0915 19:23:08.853947  661434 main.go:130] libmachine: Parsing certificate...
	I0915 19:23:08.854018  661434 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem
	I0915 19:23:08.854044  661434 main.go:130] libmachine: Decoding PEM data...
	I0915 19:23:08.854063  661434 main.go:130] libmachine: Parsing certificate...
	I0915 19:23:08.854478  661434 cli_runner.go:115] Run: docker network inspect force-systemd-flag-20210915192308-498219 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0915 19:23:08.906778  661434 cli_runner.go:162] docker network inspect force-systemd-flag-20210915192308-498219 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0915 19:23:08.906964  661434 network_create.go:255] running [docker network inspect force-systemd-flag-20210915192308-498219] to gather additional debugging logs...
	I0915 19:23:08.906991  661434 cli_runner.go:115] Run: docker network inspect force-systemd-flag-20210915192308-498219
	W0915 19:23:08.961426  661434 cli_runner.go:162] docker network inspect force-systemd-flag-20210915192308-498219 returned with exit code 1
	I0915 19:23:08.961469  661434 network_create.go:258] error running [docker network inspect force-systemd-flag-20210915192308-498219]: docker network inspect force-systemd-flag-20210915192308-498219: exit status 1
	stdout:
	[]
	
	stderr:
	Error: No such network: force-systemd-flag-20210915192308-498219
	I0915 19:23:08.961485  661434 network_create.go:260] output of [docker network inspect force-systemd-flag-20210915192308-498219]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error: No such network: force-systemd-flag-20210915192308-498219
	
	** /stderr **
	I0915 19:23:08.961542  661434 cli_runner.go:115] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0915 19:23:09.024317  661434 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000114a70] misses:0}
	I0915 19:23:09.024383  661434 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
	I0915 19:23:09.024407  661434 network_create.go:106] attempt to create docker network force-systemd-flag-20210915192308-498219 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0915 19:23:09.024478  661434 cli_runner.go:115] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true force-systemd-flag-20210915192308-498219
	I0915 19:23:09.107440  661434 network_create.go:90] docker network force-systemd-flag-20210915192308-498219 192.168.49.0/24 created
	I0915 19:23:09.107475  661434 kic.go:106] calculated static IP "192.168.49.2" for the "force-systemd-flag-20210915192308-498219" container
	I0915 19:23:09.107523  661434 cli_runner.go:115] Run: docker ps -a --format {{.Names}}
	I0915 19:23:09.152584  661434 cli_runner.go:115] Run: docker volume create force-systemd-flag-20210915192308-498219 --label name.minikube.sigs.k8s.io=force-systemd-flag-20210915192308-498219 --label created_by.minikube.sigs.k8s.io=true
	I0915 19:23:09.198626  661434 oci.go:102] Successfully created a docker volume force-systemd-flag-20210915192308-498219
	I0915 19:23:09.198718  661434 cli_runner.go:115] Run: docker run --rm --name force-systemd-flag-20210915192308-498219-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-flag-20210915192308-498219 --entrypoint /usr/bin/test -v force-systemd-flag-20210915192308-498219:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 -d /var/lib
	I0915 19:23:10.026842  661434 oci.go:106] Successfully prepared a docker volume force-systemd-flag-20210915192308-498219
	W0915 19:23:10.026895  661434 oci.go:135] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0915 19:23:10.026905  661434 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.
	I0915 19:23:10.026922  661434 preload.go:131] Checking if preload exists for k8s version v1.22.1 and runtime containerd
	I0915 19:23:10.026958  661434 kic.go:179] Starting extracting preloaded images to volume ...
	I0915 19:23:10.026963  661434 cli_runner.go:115] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0915 19:23:10.027026  661434 cli_runner.go:115] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v force-systemd-flag-20210915192308-498219:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 -I lz4 -xf /preloaded.tar -C /extractDir
	I0915 19:23:10.132975  661434 cli_runner.go:115] Run: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname force-systemd-flag-20210915192308-498219 --name force-systemd-flag-20210915192308-498219 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-flag-20210915192308-498219 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=force-systemd-flag-20210915192308-498219 --network force-systemd-flag-20210915192308-498219 --ip 192.168.49.2 --volume force-systemd-flag-20210915192308-498219:/var --security-opt apparmor=unconfined --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56
	I0915 19:23:10.742004  661434 cli_runner.go:115] Run: docker container inspect force-systemd-flag-20210915192308-498219 --format={{.State.Running}}
	I0915 19:23:10.799435  661434 cli_runner.go:115] Run: docker container inspect force-systemd-flag-20210915192308-498219 --format={{.State.Status}}
	I0915 19:23:10.858892  661434 cli_runner.go:115] Run: docker exec force-systemd-flag-20210915192308-498219 stat /var/lib/dpkg/alternatives/iptables
	I0915 19:23:10.999260  661434 oci.go:281] the created container "force-systemd-flag-20210915192308-498219" has a running status.
	I0915 19:23:10.999290  661434 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/force-systemd-flag-20210915192308-498219/id_rsa...
	I0915 19:23:11.678269  661434 vm_assets.go:109] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/force-systemd-flag-20210915192308-498219/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0915 19:23:11.678341  661434 kic_runner.go:188] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/force-systemd-flag-20210915192308-498219/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0915 19:23:12.090449  661434 cli_runner.go:115] Run: docker container inspect force-systemd-flag-20210915192308-498219 --format={{.State.Status}}
	I0915 19:23:12.137300  661434 kic_runner.go:94] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0915 19:23:12.137335  661434 kic_runner.go:115] Args: [docker exec --privileged force-systemd-flag-20210915192308-498219 chown docker:docker /home/docker/.ssh/authorized_keys]
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID
	8a0ee0c424319       6e38f40d628db       25 seconds ago       Running             storage-provisioner       0                   f553a8f9f4bdb
	4e3e2ce59d5c1       8d147537fb7d1       56 seconds ago       Running             coredns                   0                   7ea0d242ee6d7
	add40aaf7d1e1       6de166512aa22       About a minute ago   Running             kindnet-cni               0                   84d365a86ab31
	0f8eb1bcec3c0       36c4ebbc9d979       About a minute ago   Running             kube-proxy                0                   615b93865a245
	ffa7fe563436a       6e002eb89a881       About a minute ago   Running             kube-controller-manager   0                   9801458e1a86a
	f9a6017a48e43       aca5ededae9c8       About a minute ago   Running             kube-scheduler            0                   88a3889c95bb5
	c59a5411d0a43       f30469a2491a5       About a minute ago   Running             kube-apiserver            0                   af1e2cc7dc24b
	68c751171dcd7       0048118155842       About a minute ago   Running             etcd                      0                   d9f651544d709
	
	* 
	* ==> containerd <==
	* -- Logs begin at Wed 2021-09-15 19:20:45 UTC, end at Wed 2021-09-15 19:23:17 UTC. --
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289115815Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289128254Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289138345Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289254269Z" level=warning msg="`default_runtime` is deprecated, please use `default_runtime_name` to reference the default configuration you have defined in `runtimes`"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289308982Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:default DefaultRuntime:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} UntrustedWorkloadRuntime:{Type: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} Runtimes:map[default:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} runc:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:0xc0003e8f60 PrivilegedWithoutHostDevices:false BaseRuntimeSpec:}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:false} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPlugi
nConfDir:/etc/cni/net.mk NetworkPluginMaxConfNum:1 NetworkPluginConfTemplate:} Registry:{Mirrors:map[docker.io:{Endpoints:[https://registry-1.docker.io]}] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:} DisableTCPService:true StreamServerAddress: StreamServerPort:10010 StreamIdleTimeout:4h0m0s EnableSelinux:false SelinuxCategoryRange:1024 SandboxImage:k8s.gcr.io/pause:3.5 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true IgnoreImageDefinedVolumes:false} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289381402Z" level=info msg="Connect containerd service"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.289437523Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\""
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290081182Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290147751Z" level=info msg="Start subscribing containerd event"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290222669Z" level=info msg="Start recovering state"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290327818Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.290751047Z" level=info msg=serving... address=/run/containerd/containerd.sock
	Sep 15 19:22:39 pause-20210915191717-498219 systemd[1]: Started containerd container runtime.
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.292542658Z" level=info msg="containerd successfully booted in 0.059289s"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373258157Z" level=info msg="Start event monitor"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373302442Z" level=info msg="Start snapshots syncer"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373315590Z" level=info msg="Start cni network conf syncer"
	Sep 15 19:22:39 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:39.373323115Z" level=info msg="Start streaming server"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.004127018Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:b89fc9f6-92a3-4764-a891-43683f852797,Namespace:kube-system,Attempt:0,}"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.022589782Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406 pid=3354
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.189609846Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:b89fc9f6-92a3-4764-a891-43683f852797,Namespace:kube-system,Attempt:0,} returns sandbox id \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.192476910Z" level=info msg="CreateContainer within sandbox \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.264711641Z" level=info msg="CreateContainer within sandbox \"f553a8f9f4bdb64d6772af5d3227dca049bac9630159041979d1606e82f08406\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.265309072Z" level=info msg="StartContainer for \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\""
	Sep 15 19:22:52 pause-20210915191717-498219 containerd[3063]: time="2021-09-15T19:22:52.426381063Z" level=info msg="StartContainer for \"8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de\" returns successfully"
	
	* 
	* ==> coredns [4e3e2ce59d5c18a575c0fcd0817a37be6f3100ed723ce065f62dde7f1eb0a51c] <==
	* .:53
	[INFO] plugin/reload: Running configuration MD5 = e58989e162233e5f3ebed8edb075da2b
	CoreDNS-1.8.4
	linux/amd64, go1.16.4, 053c4d5
	
	* 
	* ==> describe nodes <==
	* Name:               pause-20210915191717-498219
	Roles:              control-plane,master
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=pause-20210915191717-498219
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=66748304c4ca78061b718f95ac626a53ac360876
	                    minikube.k8s.io/name=pause-20210915191717-498219
	                    minikube.k8s.io/updated_at=2021_09_15T19_21_45_0700
	                    minikube.k8s.io/version=v1.23.0
	                    node-role.kubernetes.io/control-plane=
	                    node-role.kubernetes.io/master=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Wed, 15 Sep 2021 19:21:41 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  pause-20210915191717-498219
	  AcquireTime:     <unset>
	  RenewTime:       Wed, 15 Sep 2021 19:23:12 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:21:37 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Wed, 15 Sep 2021 19:22:49 +0000   Wed, 15 Sep 2021 19:22:15 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.76.2
	  Hostname:    pause-20210915191717-498219
	Capacity:
	  cpu:                8
	  ephemeral-storage:  309568300Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32951368Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  309568300Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32951368Ki
	  pods:               110
	System Info:
	  Machine ID:                 4b5e5cdd53d44f5ab575bb522d42acca
	  System UUID:                6c096439-dfd0-4bf2-9d72-aed11150be6a
	  Boot ID:                    d1f48c72-ac32-4c43-bb38-cbe6179197b8
	  Kernel Version:             4.9.0-16-amd64
	  OS Image:                   Ubuntu 20.04.2 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.4.9
	  Kubelet Version:            v1.22.1
	  Kube-Proxy Version:         v1.22.1
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (8 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  kube-system                 coredns-78fcd69978-87x4l                               100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     80s
	  kube-system                 etcd-pause-20210915191717-498219                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         92s
	  kube-system                 kindnet-m5zrb                                          100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      80s
	  kube-system                 kube-apiserver-pause-20210915191717-498219             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         94s
	  kube-system                 kube-controller-manager-pause-20210915191717-498219    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         92s
	  kube-system                 kube-proxy-x78hq                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         80s
	  kube-system                 kube-scheduler-pause-20210915191717-498219             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         92s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         26s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                850m (10%!)(MISSING)  100m (1%!)(MISSING)
	  memory             220Mi (0%!)(MISSING)  220Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                  From     Message
	  ----    ------                   ----                 ----     -------
	  Normal  Starting                 102s                 kubelet  Starting kubelet.
	  Normal  NodeHasSufficientMemory  101s (x3 over 101s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    101s (x3 over 101s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     101s (x2 over 101s)  kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  101s                 kubelet  Updated Node Allocatable limit across pods
	  Normal  Starting                 93s                  kubelet  Starting kubelet.
	  Normal  NodeHasSufficientMemory  92s                  kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    92s                  kubelet  Node pause-20210915191717-498219 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     92s                  kubelet  Node pause-20210915191717-498219 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  92s                  kubelet  Updated Node Allocatable limit across pods
	  Normal  NodeReady                62s                  kubelet  Node pause-20210915191717-498219 status is now: NodeReady
	
	* 
	* ==> dmesg <==
	* [Sep15 19:15] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:16] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth7ac412fc
	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 0e 03 57 43 c3 f6 08 06        ........WC....
	[Sep15 19:17] cgroup: cgroup2: unknown option "nsdelegate"
	[ +24.447023] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:19] cgroup: cgroup2: unknown option "nsdelegate"
	[ +29.341499] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:20] cgroup: cgroup2: unknown option "nsdelegate"
	[  +7.752932] cgroup: cgroup2: unknown option "nsdelegate"
	[  +1.168476] cgroup: cgroup2: unknown option "nsdelegate"
	[  +0.883365] cgroup: cgroup2: unknown option "nsdelegate"
	[Sep15 19:21] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethc7f59d8a
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff fe 62 09 bc 6e 99 08 06        .......b..n...
	[  +4.026078] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethae8b0a09
	[  +0.000001] ll header: 00000000: ff ff ff ff ff ff 76 c5 05 52 bd 2c 08 06        ......v..R.,..
	[  +2.294384] IPv4: martian source 10.244.0.3 from 10.244.0.3, on dev vethee7d8cc4
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 42 f1 0d a2 67 58 08 06        ......B...gX..
	[Sep15 19:22] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth2dc59167
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 32 6a 0d 06 42 d3 08 06        ......2j..B...
	[  +2.711472] IPv4: martian source 10.244.0.4 from 10.244.0.4, on dev veth4dd80444
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 66 3a 96 9d c7 49 08 06        ......f:...I..
	[ +13.259098] cgroup: cgroup2: unknown option "nsdelegate"
	[  +0.866691] IPv4: martian source 10.244.0.5 from 10.244.0.5, on dev vethbabe3094
	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 5e 69 cf 9d 65 c0 08 06        ......^i..e...
	[Sep15 19:23] cgroup: cgroup2: unknown option "nsdelegate"
	
	* 
	* ==> etcd [68c751171dcd7d647b503ddd8a23729be4c80075be04f4911d2d09c0cd2ef1d6] <==
	* {"level":"warn","ts":"2021-09-15T19:23:02.791Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:01.794Z","time spent":"997.399319ms","remote":"127.0.0.1:38158","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":599,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" mod_revision:524 > success:<request_put:<key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" value_size:531 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/pause-20210915191717-498219\" > >"}
	{"level":"info","ts":"2021-09-15T19:23:02.791Z","caller":"traceutil/trace.go:171","msg":"trace[1006913848] linearizableReadLoop","detail":"{readStateIndex:570; appliedIndex:569; }","duration":"2.591966237s","start":"2021-09-15T19:23:00.199Z","end":"2021-09-15T19:23:02.791Z","steps":["trace[1006913848] 'read index received'  (duration: 913.0891ms)","trace[1006913848] 'applied index is now lower than readState.Index'  (duration: 1.678875336s)"],"step_count":2}
	{"level":"warn","ts":"2021-09-15T19:23:02.791Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:22:59.852Z","time spent":"2.939831065s","remote":"127.0.0.1:38060","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1114,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" mod_revision:545 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" value_size:1041 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" > >"}
	{"level":"warn","ts":"2021-09-15T19:23:03.292Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":15638323004940351675,"retry-timeout":"500ms"}
	{"level":"warn","ts":"2021-09-15T19:23:03.792Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":15638323004940351675,"retry-timeout":"500ms"}
	{"level":"warn","ts":"2021-09-15T19:23:03.996Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.056444461s","expected-duration":"1s"}
	{"level":"info","ts":"2021-09-15T19:23:03.996Z","caller":"traceutil/trace.go:171","msg":"trace[994553924] linearizableReadLoop","detail":"{readStateIndex:571; appliedIndex:571; }","duration":"1.204874877s","start":"2021-09-15T19:23:02.791Z","end":"2021-09-15T19:23:03.996Z","steps":["trace[994553924] 'read index received'  (duration: 1.204854238s)","trace[994553924] 'applied index is now lower than readState.Index'  (duration: 18.873µs)"],"step_count":2}
	{"level":"warn","ts":"2021-09-15T19:23:03.997Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.792511814s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085\" ","response":"range_response_count:1 size:787"}
	{"level":"info","ts":"2021-09-15T19:23:03.997Z","caller":"traceutil/trace.go:171","msg":"trace[1998177799] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085; range_end:; response_count:1; response_revision:548; }","duration":"1.792595532s","start":"2021-09-15T19:23:02.205Z","end":"2021-09-15T19:23:03.997Z","steps":["trace[1998177799] 'agreement among raft nodes before linearized reading'  (duration: 1.791882626s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.997Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.204Z","time spent":"1.792678664s","remote":"127.0.0.1:38010","response type":"/etcdserverpb.KV/Range","request count":0,"request size":90,"response count":1,"response size":810,"request content":"key:\"/registry/events/kube-system/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.738122175s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[1177029980] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:548; }","duration":"1.738172063s","start":"2021-09-15T19:23:02.259Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[1177029980] 'agreement among raft nodes before linearized reading'  (duration: 1.736912592s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.259Z","time spent":"1.738230286s","remote":"127.0.0.1:38250","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":28,"request content":"key:\"/registry/health\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.493659597s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[2071497708] range","detail":"{range_begin:/registry/networkpolicies/; range_end:/registry/networkpolicies0; response_count:0; response_revision:548; }","duration":"1.493691663s","start":"2021-09-15T19:23:02.504Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[2071497708] 'agreement among raft nodes before linearized reading'  (duration: 1.492292928s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.504Z","time spent":"1.493733527s","remote":"127.0.0.1:38170","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":0,"response size":28,"request content":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.789357774s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"830.565162ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/default\" ","response":"range_response_count:1 size:343"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[1354754751] range","detail":"{range_begin:/registry/namespaces/default; range_end:; response_count:1; response_revision:548; }","duration":"830.609729ms","start":"2021-09-15T19:23:03.167Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[1354754751] 'agreement among raft nodes before linearized reading'  (duration: 828.900071ms)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:03.167Z","time spent":"830.664651ms","remote":"127.0.0.1:38054","response type":"/etcdserverpb.KV/Range","request count":0,"request size":30,"response count":1,"response size":366,"request content":"key:\"/registry/namespaces/default\" "}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.827186779s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" ","response":"range_response_count:1 size:4936"}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[554460785] range","detail":"{range_begin:/registry/minions/; range_end:/registry/minions0; response_count:1; response_revision:548; }","duration":"2.827248402s","start":"2021-09-15T19:23:01.171Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[554460785] 'agreement among raft nodes before linearized reading'  (duration: 2.825281977s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:01.171Z","time spent":"2.827299141s","remote":"127.0.0.1:38068","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":1,"response size":4959,"request content":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" "}
	{"level":"info","ts":"2021-09-15T19:23:03.998Z","caller":"traceutil/trace.go:171","msg":"trace[483421495] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:548; }","duration":"1.789408028s","start":"2021-09-15T19:23:02.209Z","end":"2021-09-15T19:23:03.998Z","steps":["trace[483421495] 'agreement among raft nodes before linearized reading'  (duration: 1.787721349s)"],"step_count":1}
	{"level":"warn","ts":"2021-09-15T19:23:03.998Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:23:02.209Z","time spent":"1.78980824s","remote":"127.0.0.1:38250","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":28,"request content":"key:\"/registry/health\" "}
	
	* 
	* ==> kernel <==
	*  19:23:17 up  5:05,  0 users,  load average: 8.73, 4.63, 2.41
	Linux pause-20210915191717-498219 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.2 LTS"
	
	* 
	* ==> kube-apiserver [c59a5411d0a433dc24d4b92cbfe6897ccefe0c7791ebb38fa78a538f7451455a] <==
	* Trace[1935315716]: ---"Transaction committed" 2940ms (19:23:02.792)
	Trace[1935315716]: [2.941327631s] [2.941327631s] END
	I0915 19:23:02.792544       1 trace.go:205] Trace[160500084]: "GuaranteedUpdate etcd3" type:*coordination.Lease (15-Sep-2021 19:23:01.793) (total time: 999ms):
	Trace[160500084]: ---"Transaction committed" 998ms (19:23:02.792)
	Trace[160500084]: [999.103304ms] [999.103304ms] END
	I0915 19:23:02.792708       1 trace.go:205] Trace[83543991]: "Update" url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath,user-agent:storage-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:17b9dfd5-5501-45f7-b3cd-14cd9632e7f8,client:192.168.76.2,accept:application/json, */*,protocol:HTTP/2.0 (15-Sep-2021 19:22:59.850) (total time: 2941ms):
	Trace[83543991]: ---"Object stored in database" 2941ms (19:23:02.792)
	Trace[83543991]: [2.941792202s] [2.941792202s] END
	I0915 19:23:02.792810       1 trace.go:205] Trace[461359119]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210915191717-498219,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:3e3d5ee5-e1f3-456b-82ca-ded19898029f,client:192.168.76.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:23:01.793) (total time: 999ms):
	Trace[461359119]: ---"Object stored in database" 999ms (19:23:02.792)
	Trace[461359119]: [999.531575ms] [999.531575ms] END
	I0915 19:23:03.999781       1 trace.go:205] Trace[988981254]: "Get" url:/api/v1/namespaces/default,user-agent:kube-apiserver/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:a108ccf7-c083-4410-8746-c981a95f95e5,client:127.0.0.1,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (15-Sep-2021 19:23:03.167) (total time: 832ms):
	Trace[988981254]: ---"About to write a response" 832ms (19:23:03.999)
	Trace[988981254]: [832.240765ms] [832.240765ms] END
	I0915 19:23:04.000645       1 trace.go:205] Trace[1888490700]: "GuaranteedUpdate etcd3" type:*core.Event (15-Sep-2021 19:23:02.204) (total time: 1796ms):
	Trace[1888490700]: ---"initial value restored" 1794ms (19:23:03.998)
	Trace[1888490700]: [1.796117778s] [1.796117778s] END
	I0915 19:23:04.000797       1 trace.go:205] Trace[257925177]: "Patch" url:/api/v1/namespaces/kube-system/events/kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:d6b68a1f-53de-45b4-957d-2071d61dd2f7,client:192.168.76.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:23:02.204) (total time: 1796ms):
	Trace[257925177]: ---"About to apply patch" 1794ms (19:23:03.998)
	Trace[257925177]: [1.796536176s] [1.796536176s] END
	I0915 19:23:04.001586       1 trace.go:205] Trace[607332746]: "List etcd3" key:/minions,resourceVersion:,resourceVersionMatch:,limit:0,continue: (15-Sep-2021 19:23:01.171) (total time: 2830ms):
	Trace[607332746]: [2.830446727s] [2.830446727s] END
	I0915 19:23:04.002006       1 trace.go:205] Trace[557314537]: "List" url:/api/v1/nodes,user-agent:kindnetd/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:daca3847-81a5-42d6-bc90-18e89e76e274,client:192.168.76.2,accept:application/json, */*,protocol:HTTP/2.0 (15-Sep-2021 19:23:01.171) (total time: 2830ms):
	Trace[557314537]: ---"Listing from storage done" 2830ms (19:23:04.001)
	Trace[557314537]: [2.830874436s] [2.830874436s] END
	
	* 
	* ==> kube-controller-manager [ffa7fe563436a7ae8d7cecd36b9ff38df2bcc5435d8942a21f17d65219db5c80] <==
	* I0915 19:21:56.621813       1 shared_informer.go:247] Caches are synced for GC 
	I0915 19:21:56.666633       1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring 
	I0915 19:21:56.737104       1 shared_informer.go:247] Caches are synced for HPA 
	I0915 19:21:56.771555       1 shared_informer.go:247] Caches are synced for TTL after finished 
	I0915 19:21:56.776318       1 shared_informer.go:247] Caches are synced for resource quota 
	I0915 19:21:56.786816       1 shared_informer.go:247] Caches are synced for bootstrap_signer 
	I0915 19:21:56.814494       1 shared_informer.go:247] Caches are synced for cronjob 
	I0915 19:21:56.815608       1 shared_informer.go:247] Caches are synced for job 
	I0915 19:21:56.816836       1 shared_informer.go:247] Caches are synced for resource quota 
	I0915 19:21:56.849367       1 shared_informer.go:247] Caches are synced for crt configmap 
	I0915 19:21:57.069440       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"
	I0915 19:21:57.245086       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0915 19:21:57.258419       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0915 19:21:57.258447       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0915 19:21:57.424897       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-m5zrb"
	I0915 19:21:57.426662       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-x78hq"
	I0915 19:21:57.620526       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-2cj9r"
	I0915 19:21:57.626422       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-87x4l"
	I0915 19:21:57.831742       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"
	I0915 19:21:57.850742       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-2cj9r"
	I0915 19:22:21.597081       1 node_lifecycle_controller.go:1191] Controller detected that some Nodes are Ready. Exiting master disruption mode.
	W0915 19:22:30.529868       1 endpointslice_controller.go:306] Error syncing endpoint slices for service "kube-system/kube-dns", retrying. Error: failed to update kube-dns-bdr96 EndpointSlice for Service kube-system/kube-dns: etcdserver: request timed out
	I0915 19:22:30.529995       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Service" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpointSlices" message="Error updating Endpoint Slices for Service kube-system/kube-dns: failed to update kube-dns-bdr96 EndpointSlice for Service kube-system/kube-dns: etcdserver: request timed out"
	I0915 19:22:30.535845       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint kube-system/kube-dns: etcdserver: request timed out"
	I0915 19:22:31.128758       1 event.go:291] "Event occurred" object="kube-system/kube-dns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint kube-system/kube-dns: Operation cannot be fulfilled on endpoints \"kube-dns\": the object has been modified; please apply your changes to the latest version and try again"
	
	* 
	* ==> kube-proxy [0f8eb1bcec3c031e531b43c748eea2d33912cf7d55db49e7ea71778813c0c49d] <==
	* I0915 19:22:00.149349       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I0915 19:22:00.149412       1 server_others.go:140] Detected node IP 192.168.76.2
	W0915 19:22:00.149443       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy
	I0915 19:22:00.224185       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary
	I0915 19:22:00.224227       1 server_others.go:212] Using iptables Proxier.
	I0915 19:22:00.224243       1 server_others.go:219] creating dualStackProxier for iptables.
	W0915 19:22:00.224268       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
	I0915 19:22:00.224633       1 server.go:649] Version: v1.22.1
	I0915 19:22:00.225573       1 config.go:315] Starting service config controller
	I0915 19:22:00.225594       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0915 19:22:00.225648       1 config.go:224] Starting endpoint slice config controller
	I0915 19:22:00.225654       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	E0915 19:22:00.237347       1 event_broadcaster.go:253] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pause-20210915191717-498219.16a5152c5a0d5dba", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, EventTime:v1.MicroTime{Time:time.Time{wall:0xc048afd60d6ce200, ext:146529520, loc:(*time.Location)(0x2d81340)}}, Series:(*v1.EventSeries)(nil), ReportingController:"kube-proxy", ReportingInstance:"kube-proxy-pause-20210915191717-498219", Action:"StartKubeProxy", Reason:"Starting", Regarding:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"pause
-20210915191717-498219", UID:"pause-20210915191717-498219", APIVersion:"", ResourceVersion:"", FieldPath:""}, Related:(*v1.ObjectReference)(nil), Note:"", Type:"Normal", DeprecatedSource:v1.EventSource{Component:"", Host:""}, DeprecatedFirstTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedLastTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedCount:0}': 'Event "pause-20210915191717-498219.16a5152c5a0d5dba" is invalid: involvedObject.namespace: Invalid value: "": does not match event.namespace' (will not retry!)
	I0915 19:22:00.326477       1 shared_informer.go:247] Caches are synced for service config 
	I0915 19:22:00.326476       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	
	* 
	* ==> kube-scheduler [f9a6017a48e430457074558a4f8587452f4bc9da312b0a267d9b4c66ec6698a3] <==
	* E0915 19:21:41.760210       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0915 19:21:41.760303       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0915 19:21:41.760377       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0915 19:21:41.760448       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0915 19:21:41.761375       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:41.761567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0915 19:21:41.761758       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0915 19:21:41.761874       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0915 19:21:41.762011       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0915 19:21:41.762094       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:41.762150       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0915 19:21:41.762299       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0915 19:21:42.633569       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:42.633572       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0915 19:21:42.656483       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0915 19:21:42.750028       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0915 19:21:42.834567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0915 19:21:42.847835       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0915 19:21:42.905891       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0915 19:21:42.913872       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0915 19:21:44.504439       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.560422       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.562990       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	E0915 19:21:45.565584       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"
	I0915 19:21:45.957351       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Wed 2021-09-15 19:20:45 UTC, end at Wed 2021-09-15 19:23:17 UTC. --
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466612    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/78449e93-ea1e-46cd-92ca-d416ecbee251-xtables-lock\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466634    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-cni-cfg\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466653    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-xtables-lock\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466668    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b75f582d-6b59-4a29-8f66-5670fc372ef7-lib-modules\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466731    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78449e93-ea1e-46cd-92ca-d416ecbee251-lib-modules\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466791    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wcrs\" (UniqueName: \"kubernetes.io/projected/78449e93-ea1e-46cd-92ca-d416ecbee251-kube-api-access-2wcrs\") pod \"kube-proxy-x78hq\" (UID: \"78449e93-ea1e-46cd-92ca-d416ecbee251\") "
	Sep 15 19:21:57 pause-20210915191717-498219 kubelet[1889]: I0915 19:21:57.466837    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdpn4\" (UniqueName: \"kubernetes.io/projected/b75f582d-6b59-4a29-8f66-5670fc372ef7-kube-api-access-cdpn4\") pod \"kindnet-m5zrb\" (UID: \"b75f582d-6b59-4a29-8f66-5670fc372ef7\") "
	Sep 15 19:22:00 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:00.444629    1889 kubelet.go:2332] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:19.178108    1889 event.go:264] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-pause-20210915191717-498219.16a5152f21cf9085", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-pause-20210915191717-498219", UID:"7711ec5bdcd091468467911b3afef6b2", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"Unhealthy", Message:"Readiness
probe failed: HTTP probe failed with statuscode: 500", Source:v1.EventSource{Component:"kubelet", Host:"pause-20210915191717-498219"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc048afd909eda885, ext:27550152024, loc:(*time.Location)(0x55f11597a660)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc048afd909eda885, ext:27550152024, loc:(*time.Location)(0x55f11597a660)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'etcdserver: request timed out' (will not retry!)
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.742011    1889 topology_manager.go:200] "Topology Admit Handler"
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.807643    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bacedd06-5f04-410d-bb77-6d7082ac74d8-config-volume\") pod \"coredns-78fcd69978-87x4l\" (UID: \"bacedd06-5f04-410d-bb77-6d7082ac74d8\") "
	Sep 15 19:22:19 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:19.807946    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrzf5\" (UniqueName: \"kubernetes.io/projected/bacedd06-5f04-410d-bb77-6d7082ac74d8-kube-api-access-mrzf5\") pod \"coredns-78fcd69978-87x4l\" (UID: \"bacedd06-5f04-410d-bb77-6d7082ac74d8\") "
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: W0915 19:22:39.201764    1889 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: W0915 19:22:39.201764    1889 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251093    1889 remote_runtime.go:207] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\"" filter="&PodSandboxFilter{Id:,State:&PodSandboxStateValue{State:SANDBOX_READY,},LabelSelector:map[string]string{},}"
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251148    1889 kuberuntime_sandbox.go:281] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251163    1889 kubelet_pods.go:1117] "Error listing containers" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.251179    1889 kubelet.go:2143] "Failed cleaning pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.322958    1889 remote_runtime.go:207] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\"" filter="nil"
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.323017    1889 kuberuntime_sandbox.go:281] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.323041    1889 generic.go:205] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:39 pause-20210915191717-498219 kubelet[1889]: E0915 19:22:39.752088    1889 remote_runtime.go:86] "Version from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.700577    1889 topology_manager.go:200] "Topology Admit Handler"
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.739217    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/b89fc9f6-92a3-4764-a891-43683f852797-tmp\") pod \"storage-provisioner\" (UID: \"b89fc9f6-92a3-4764-a891-43683f852797\") "
	Sep 15 19:22:51 pause-20210915191717-498219 kubelet[1889]: I0915 19:22:51.739305    1889 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnnvv\" (UniqueName: \"kubernetes.io/projected/b89fc9f6-92a3-4764-a891-43683f852797-kube-api-access-mnnvv\") pod \"storage-provisioner\" (UID: \"b89fc9f6-92a3-4764-a891-43683f852797\") "
	
	* 
	* ==> storage-provisioner [8a0ee0c42431993928a4defa7d9d7c9237558384cfeebac72acf8a5a49c748de] <==
	* I0915 19:22:52.434096       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0915 19:22:52.442402       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0915 19:22:52.442449       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0915 19:22:52.449631       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0915 19:22:52.449779       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554!
	I0915 19:22:52.449737       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"edcec5d9-3929-420f-ac85-43ebcaef7c79", APIVersion:"v1", ResourceVersion:"540", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554 became leader
	I0915 19:22:52.550239       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_pause-20210915191717-498219_424bcccc-1cb4-4ba2-bfe7-90e9f12e9554!
	

                                                
                                                
-- /stdout --
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20210915191717-498219 -n pause-20210915191717-498219
helpers_test.go:262: (dbg) Run:  kubectl --context pause-20210915191717-498219 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:271: non-running pods: 
helpers_test.go:273: ======> post-mortem[TestPause/serial/PauseAgain]: describe non-running pods <======
helpers_test.go:276: (dbg) Run:  kubectl --context pause-20210915191717-498219 describe pod 
helpers_test.go:276: (dbg) Non-zero exit: kubectl --context pause-20210915191717-498219 describe pod : exit status 1 (76.66988ms)

                                                
                                                
** stderr ** 
	error: resource name may not be empty

                                                
                                                
** /stderr **
helpers_test.go:278: kubectl --context pause-20210915191717-498219 describe pod : exit status 1
--- FAIL: TestPause/serial/PauseAgain (6.51s)

                                                
                                    

Test pass (245/274)

Order passed test Duration
3 TestDownloadOnly/v1.14.0/json-events 9.11
4 TestDownloadOnly/v1.14.0/preload-exists 0
8 TestDownloadOnly/v1.14.0/LogsDuration 0.07
10 TestDownloadOnly/v1.22.1/json-events 18.96
11 TestDownloadOnly/v1.22.1/preload-exists 0
15 TestDownloadOnly/v1.22.1/LogsDuration 0.07
17 TestDownloadOnly/v1.22.2-rc.0/json-events 10.28
18 TestDownloadOnly/v1.22.2-rc.0/preload-exists 0
22 TestDownloadOnly/v1.22.2-rc.0/LogsDuration 0.07
23 TestDownloadOnly/DeleteAll 0.38
24 TestDownloadOnly/DeleteAlwaysSucceeds 0.23
25 TestDownloadOnlyKic 9.57
26 TestOffline 284.23
28 TestAddons/Setup 131.28
30 TestAddons/parallel/Registry 16.7
31 TestAddons/parallel/Ingress 46.47
32 TestAddons/parallel/MetricsServer 5.64
33 TestAddons/parallel/HelmTiller 9.32
34 TestAddons/parallel/Olm 35.57
35 TestAddons/parallel/CSI 44.59
36 TestAddons/parallel/GCPAuth 44.64
37 TestAddons/StoppedEnableDisable 20.9
38 TestCertOptions 46.56
40 TestForceSystemdFlag 57.37
41 TestForceSystemdEnv 272.71
42 TestKVMDriverInstallOrUpdate 2.88
46 TestErrorSpam/setup 43.01
47 TestErrorSpam/start 0.94
48 TestErrorSpam/status 1.13
49 TestErrorSpam/pause 2.5
50 TestErrorSpam/unpause 1.47
51 TestErrorSpam/stop 23.42
54 TestFunctional/serial/CopySyncFile 0
55 TestFunctional/serial/StartWithProxy 69.22
56 TestFunctional/serial/AuditLog 0
57 TestFunctional/serial/SoftStart 15.6
58 TestFunctional/serial/KubeContext 0.05
59 TestFunctional/serial/KubectlGetPods 0.17
62 TestFunctional/serial/CacheCmd/cache/add_remote 3.25
63 TestFunctional/serial/CacheCmd/cache/add_local 2.03
64 TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3 0.05
65 TestFunctional/serial/CacheCmd/cache/list 0.05
66 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.35
67 TestFunctional/serial/CacheCmd/cache/cache_reload 2.04
68 TestFunctional/serial/CacheCmd/cache/delete 0.11
69 TestFunctional/serial/MinikubeKubectlCmd 0.1
70 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.1
71 TestFunctional/serial/ExtraConfig 43.51
72 TestFunctional/serial/ComponentHealth 0.07
73 TestFunctional/serial/LogsCmd 1.05
74 TestFunctional/serial/LogsFileCmd 1.11
76 TestFunctional/parallel/ConfigCmd 0.37
77 TestFunctional/parallel/DashboardCmd 5.15
78 TestFunctional/parallel/DryRun 0.57
79 TestFunctional/parallel/InternationalLanguage 0.26
80 TestFunctional/parallel/StatusCmd 1.3
83 TestFunctional/parallel/ServiceCmd 18.11
84 TestFunctional/parallel/AddonsCmd 0.15
85 TestFunctional/parallel/PersistentVolumeClaim 30.18
87 TestFunctional/parallel/SSHCmd 0.82
88 TestFunctional/parallel/CpCmd 0.73
89 TestFunctional/parallel/MySQL 18.24
90 TestFunctional/parallel/FileSync 0.4
91 TestFunctional/parallel/CertSync 2.39
95 TestFunctional/parallel/NodeLabels 0.06
96 TestFunctional/parallel/LoadImage 2.58
97 TestFunctional/parallel/SaveImage 3.5
98 TestFunctional/parallel/RemoveImage 2.87
99 TestFunctional/parallel/LoadImageFromFile 2.37
100 TestFunctional/parallel/SaveImageToFile 3.45
101 TestFunctional/parallel/BuildImage 3.63
102 TestFunctional/parallel/ListImages 0.24
103 TestFunctional/parallel/NonActiveRuntimeDisabled 0.94
106 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
108 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 16.22
109 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.06
110 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
114 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
115 TestFunctional/parallel/ProfileCmd/profile_not_create 0.5
116 TestFunctional/parallel/MountCmd/any-port 7.68
117 TestFunctional/parallel/ProfileCmd/profile_list 0.45
118 TestFunctional/parallel/ProfileCmd/profile_json_output 0.52
119 TestFunctional/parallel/Version/short 0.06
120 TestFunctional/parallel/Version/components 0.54
121 TestFunctional/parallel/MountCmd/specific-port 2.37
122 TestFunctional/parallel/UpdateContextCmd/no_changes 0.19
123 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.2
124 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.2
125 TestFunctional/delete_busybox_image 0.09
126 TestFunctional/delete_my-image_image 0.04
127 TestFunctional/delete_minikube_cached_images 0.04
131 TestJSONOutput/start/Command 66.85
132 TestJSONOutput/start/Audit 0
134 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
135 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
137 TestJSONOutput/pause/Command 0.63
138 TestJSONOutput/pause/Audit 0
140 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
141 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
143 TestJSONOutput/unpause/Command 0.62
144 TestJSONOutput/unpause/Audit 0
146 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
147 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
149 TestJSONOutput/stop/Command 24.23
150 TestJSONOutput/stop/Audit 0
152 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
153 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
154 TestErrorJSONOutput 0.34
156 TestKicCustomNetwork/create_custom_network 27.67
157 TestKicCustomNetwork/use_default_bridge_network 24.66
158 TestKicExistingNetwork 24.38
159 TestMainNoArgs 0.05
162 TestMultiNode/serial/FreshStart2Nodes 97.77
163 TestMultiNode/serial/DeployApp2Nodes 5.62
164 TestMultiNode/serial/PingHostFrom2Pods 0.8
165 TestMultiNode/serial/AddNode 43.84
166 TestMultiNode/serial/ProfileList 0.37
167 TestMultiNode/serial/CopyFile 2.83
168 TestMultiNode/serial/StopNode 21.98
169 TestMultiNode/serial/StartAfterStop 35.88
170 TestMultiNode/serial/RestartKeepsNodes 192.64
171 TestMultiNode/serial/DeleteNode 25.2
172 TestMultiNode/serial/StopMultiNode 41.39
173 TestMultiNode/serial/RestartMultiNode 93.04
174 TestMultiNode/serial/ValidateNameConflict 47.17
180 TestDebPackageInstall/install_amd64_debian_sid/minikube 0
181 TestDebPackageInstall/install_amd64_debian_sid/kvm2-driver 11.73
183 TestDebPackageInstall/install_amd64_debian_latest/minikube 0
184 TestDebPackageInstall/install_amd64_debian_latest/kvm2-driver 10.14
186 TestDebPackageInstall/install_amd64_debian_10/minikube 0
187 TestDebPackageInstall/install_amd64_debian_10/kvm2-driver 10
189 TestDebPackageInstall/install_amd64_debian_9/minikube 0
190 TestDebPackageInstall/install_amd64_debian_9/kvm2-driver 8.21
192 TestDebPackageInstall/install_amd64_ubuntu_latest/minikube 0
193 TestDebPackageInstall/install_amd64_ubuntu_latest/kvm2-driver 147.3
195 TestDebPackageInstall/install_amd64_ubuntu_20.10/minikube 0
196 TestDebPackageInstall/install_amd64_ubuntu_20.10/kvm2-driver 190.55
198 TestDebPackageInstall/install_amd64_ubuntu_20.04/minikube 0
199 TestDebPackageInstall/install_amd64_ubuntu_20.04/kvm2-driver 138.81
201 TestDebPackageInstall/install_amd64_ubuntu_18.04/minikube 0
203 TestPreload 134.99
208 TestInsufficientStorage 13.56
209 TestRunningBinaryUpgrade 152.03
211 TestKubernetesUpgrade 215.87
212 TestMissingContainerUpgrade 130.36
217 TestPause/serial/Start 319.54
222 TestNetworkPlugins/group/false 1.12
226 TestStoppedBinaryUpgrade/Upgrade 347.26
227 TestPause/serial/SecondStartNoReconfiguration 16.1
237 TestPause/serial/Unpause 0.7
239 TestPause/serial/DeletePaused 3.08
240 TestPause/serial/VerifyDeletedResources 0.69
241 TestNetworkPlugins/group/auto/Start 75.77
242 TestNetworkPlugins/group/custom-weave/Start 79.77
243 TestNetworkPlugins/group/cilium/Start 90.45
244 TestNetworkPlugins/group/auto/KubeletFlags 0.37
245 TestNetworkPlugins/group/auto/NetCatPod 8.31
246 TestNetworkPlugins/group/custom-weave/KubeletFlags 0.4
247 TestNetworkPlugins/group/custom-weave/NetCatPod 8.32
248 TestNetworkPlugins/group/auto/DNS 0.15
249 TestNetworkPlugins/group/auto/Localhost 0.16
250 TestNetworkPlugins/group/auto/HairPin 0.16
251 TestNetworkPlugins/group/calico/Start 82.72
252 TestNetworkPlugins/group/enable-default-cni/Start 60.68
253 TestNetworkPlugins/group/cilium/ControllerPod 5.02
254 TestNetworkPlugins/group/cilium/KubeletFlags 0.39
255 TestNetworkPlugins/group/cilium/NetCatPod 9.5
256 TestNetworkPlugins/group/cilium/DNS 0.19
257 TestNetworkPlugins/group/cilium/Localhost 0.25
258 TestNetworkPlugins/group/cilium/HairPin 0.25
259 TestNetworkPlugins/group/kindnet/Start 71.77
260 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.45
261 TestNetworkPlugins/group/enable-default-cni/NetCatPod 9.25
262 TestNetworkPlugins/group/enable-default-cni/DNS 0.28
263 TestNetworkPlugins/group/enable-default-cni/Localhost 0.22
264 TestNetworkPlugins/group/enable-default-cni/HairPin 0.25
265 TestNetworkPlugins/group/bridge/Start 82.05
266 TestNetworkPlugins/group/calico/ControllerPod 8.35
267 TestNetworkPlugins/group/calico/KubeletFlags 0.67
268 TestNetworkPlugins/group/calico/NetCatPod 10.3
269 TestNetworkPlugins/group/calico/DNS 0.16
270 TestNetworkPlugins/group/calico/Localhost 0.16
271 TestNetworkPlugins/group/calico/HairPin 0.14
273 TestStartStop/group/old-k8s-version/serial/FirstStart 141.77
274 TestStoppedBinaryUpgrade/MinikubeLogs 0.92
276 TestStartStop/group/no-preload/serial/FirstStart 86.05
277 TestNetworkPlugins/group/kindnet/ControllerPod 5.02
278 TestNetworkPlugins/group/kindnet/KubeletFlags 0.89
279 TestNetworkPlugins/group/kindnet/NetCatPod 9.23
280 TestNetworkPlugins/group/kindnet/DNS 0.23
281 TestNetworkPlugins/group/kindnet/Localhost 0.16
282 TestNetworkPlugins/group/kindnet/HairPin 0.18
284 TestStartStop/group/embed-certs/serial/FirstStart 69.72
285 TestNetworkPlugins/group/bridge/KubeletFlags 0.37
286 TestNetworkPlugins/group/bridge/NetCatPod 16.19
287 TestNetworkPlugins/group/bridge/DNS 0.15
288 TestNetworkPlugins/group/bridge/Localhost 0.16
289 TestNetworkPlugins/group/bridge/HairPin 0.15
291 TestStartStop/group/default-k8s-different-port/serial/FirstStart 72.51
292 TestStartStop/group/no-preload/serial/DeployApp 11.27
293 TestStartStop/group/embed-certs/serial/DeployApp 16.32
294 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 3.95
295 TestStartStop/group/no-preload/serial/Stop 20.77
296 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 0.76
297 TestStartStop/group/embed-certs/serial/Stop 20.82
298 TestStartStop/group/old-k8s-version/serial/DeployApp 9.37
299 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.2
300 TestStartStop/group/no-preload/serial/SecondStart 327.5
301 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.66
302 TestStartStop/group/old-k8s-version/serial/Stop 20.81
303 TestStartStop/group/default-k8s-different-port/serial/DeployApp 10.62
304 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.19
305 TestStartStop/group/embed-certs/serial/SecondStart 325.96
306 TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive 0.64
307 TestStartStop/group/default-k8s-different-port/serial/Stop 20.67
308 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.22
309 TestStartStop/group/old-k8s-version/serial/SecondStart 434.29
310 TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop 0.23
311 TestStartStop/group/default-k8s-different-port/serial/SecondStart 354.66
312 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 5.02
313 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.21
314 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 5.02
315 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.37
316 TestStartStop/group/no-preload/serial/Pause 3.01
317 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.09
318 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.39
319 TestStartStop/group/embed-certs/serial/Pause 3.51
321 TestStartStop/group/newest-cni/serial/FirstStart 55.92
322 TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop 5.04
323 TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop 5.08
324 TestStartStop/group/newest-cni/serial/DeployApp 0
325 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 0.61
326 TestStartStop/group/newest-cni/serial/Stop 20.83
327 TestStartStop/group/default-k8s-different-port/serial/VerifyKubernetesImages 0.36
328 TestStartStop/group/default-k8s-different-port/serial/Pause 2.97
329 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.19
330 TestStartStop/group/newest-cni/serial/SecondStart 35.73
331 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
332 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
333 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.37
334 TestStartStop/group/newest-cni/serial/Pause 2.73
335 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 5.01
336 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.21
337 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.36
338 TestStartStop/group/old-k8s-version/serial/Pause 2.91
x
+
TestDownloadOnly/v1.14.0/json-events (9.11s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.14.0/json-events
aaa_download_only_test.go:70: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-20210915184125-498219 --force --alsologtostderr --kubernetes-version=v1.14.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:70: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-20210915184125-498219 --force --alsologtostderr --kubernetes-version=v1.14.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (9.110353958s)
--- PASS: TestDownloadOnly/v1.14.0/json-events (9.11s)

                                                
                                    
x
+
TestDownloadOnly/v1.14.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.14.0/preload-exists
--- PASS: TestDownloadOnly/v1.14.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.14.0/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.14.0/LogsDuration
aaa_download_only_test.go:172: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-20210915184125-498219
aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-20210915184125-498219: exit status 85 (66.302024ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------|---------|------|---------|------------|----------|
	| Command | Args | Profile | User | Version | Start Time | End Time |
	|---------|------|---------|------|---------|------------|----------|
	|---------|------|---------|------|---------|------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2021/09/15 18:41:25
	Running on machine: debian-jenkins-agent-1
	Binary: Built with gc go1.17 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0915 18:41:25.641438  498231 out.go:298] Setting OutFile to fd 1 ...
	I0915 18:41:25.641656  498231 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 18:41:25.641667  498231 out.go:311] Setting ErrFile to fd 2...
	I0915 18:41:25.641671  498231 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 18:41:25.641793  498231 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	W0915 18:41:25.641922  498231 root.go:291] Error reading config file at /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/config/config.json: open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/config/config.json: no such file or directory
	I0915 18:41:25.642173  498231 out.go:305] Setting JSON to true
	I0915 18:41:25.677509  498231 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-1","uptime":15843,"bootTime":1631715442,"procs":149,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}
	I0915 18:41:25.677615  498231 start.go:121] virtualization: kvm guest
	I0915 18:41:25.680925  498231 notify.go:169] Checking for updates...
	I0915 18:41:25.682785  498231 driver.go:343] Setting default libvirt URI to qemu:///system
	I0915 18:41:25.729490  498231 docker.go:132] docker version: linux-19.03.15
	I0915 18:41:25.729595  498231 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 18:41:25.812694  498231 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:23 OomKillDisable:true NGoroutines:35 SystemTime:2021-09-15 18:41:25.76422653 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddre
ss:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warning
s:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 18:41:25.812780  498231 docker.go:237] overlay module found
	I0915 18:41:25.814950  498231 start.go:278] selected driver: docker
	I0915 18:41:25.814963  498231 start.go:751] validating driver "docker" against <nil>
	I0915 18:41:25.815483  498231 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 18:41:25.896368  498231 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:23 OomKillDisable:true NGoroutines:35 SystemTime:2021-09-15 18:41:25.850835103 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 18:41:25.896467  498231 start_flags.go:264] no existing cluster config was found, will generate one from the flags 
	I0915 18:41:25.896944  498231 start_flags.go:345] Using suggested 8000MB memory alloc based on sys=32179MB, container=32179MB
	I0915 18:41:25.897031  498231 start_flags.go:719] Wait components to verify : map[apiserver:true system_pods:true]
	I0915 18:41:25.897052  498231 cni.go:93] Creating CNI manager for ""
	I0915 18:41:25.897059  498231 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet
	I0915 18:41:25.897069  498231 cni.go:217] auto-setting extra-config to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0915 18:41:25.897076  498231 cni.go:222] extra-config set to "kubelet.cni-conf-dir=/etc/cni/net.mk"
	I0915 18:41:25.897080  498231 start_flags.go:273] Found "CNI" CNI - setting NetworkPlugin=cni
	I0915 18:41:25.897117  498231 start_flags.go:278] config:
	{Name:download-only-20210915184125-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.14.0 ClusterName:download-only-20210915184125-498219 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loc
al ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 18:41:25.899349  498231 cache.go:118] Beginning downloading kic base image for docker with containerd
	I0915 18:41:25.900950  498231 preload.go:131] Checking if preload exists for k8s version v1.14.0 and runtime containerd
	I0915 18:41:25.901051  498231 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon
	I0915 18:41:25.994643  498231 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v12-v1.14.0-containerd-overlay2-amd64.tar.lz4
	I0915 18:41:25.994684  498231 cache.go:57] Caching tarball of preloaded images
	I0915 18:41:25.994972  498231 preload.go:131] Checking if preload exists for k8s version v1.14.0 and runtime containerd
	I0915 18:41:25.997242  498231 preload.go:237] getting checksum for preloaded-images-k8s-v12-v1.14.0-containerd-overlay2-amd64.tar.lz4 ...
	I0915 18:41:26.011382  498231 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull
	I0915 18:41:26.011409  498231 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load
	I0915 18:41:26.067339  498231 download.go:92] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v12-v1.14.0-containerd-overlay2-amd64.tar.lz4?checksum=md5:03f50da280f3f84802289dd979e495ff -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.14.0-containerd-overlay2-amd64.tar.lz4
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-20210915184125-498219"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:173: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.14.0/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.22.1/json-events (18.96s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.22.1/json-events
aaa_download_only_test.go:70: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-20210915184125-498219 --force --alsologtostderr --kubernetes-version=v1.22.1 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:70: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-20210915184125-498219 --force --alsologtostderr --kubernetes-version=v1.22.1 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (18.960470608s)
--- PASS: TestDownloadOnly/v1.22.1/json-events (18.96s)

                                                
                                    
x
+
TestDownloadOnly/v1.22.1/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.22.1/preload-exists
--- PASS: TestDownloadOnly/v1.22.1/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.22.1/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.22.1/LogsDuration
aaa_download_only_test.go:172: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-20210915184125-498219
aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-20210915184125-498219: exit status 85 (66.173449ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------|---------|------|---------|------------|----------|
	| Command | Args | Profile | User | Version | Start Time | End Time |
	|---------|------|---------|------|---------|------------|----------|
	|---------|------|---------|------|---------|------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2021/09/15 18:41:34
	Running on machine: debian-jenkins-agent-1
	Binary: Built with gc go1.17 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0915 18:41:34.815784  498373 out.go:298] Setting OutFile to fd 1 ...
	I0915 18:41:34.815967  498373 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 18:41:34.815975  498373 out.go:311] Setting ErrFile to fd 2...
	I0915 18:41:34.815980  498373 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 18:41:34.816097  498373 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	W0915 18:41:34.816194  498373 root.go:291] Error reading config file at /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/config/config.json: open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/config/config.json: no such file or directory
	I0915 18:41:34.816303  498373 out.go:305] Setting JSON to true
	I0915 18:41:34.851758  498373 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-1","uptime":15853,"bootTime":1631715442,"procs":149,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}
	I0915 18:41:34.851861  498373 start.go:121] virtualization: kvm guest
	I0915 18:41:34.854490  498373 notify.go:169] Checking for updates...
	I0915 18:41:34.856499  498373 config.go:177] Loaded profile config "download-only-20210915184125-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.14.0
	W0915 18:41:34.856552  498373 start.go:659] api.Load failed for download-only-20210915184125-498219: filestore "download-only-20210915184125-498219": Docker machine "download-only-20210915184125-498219" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0915 18:41:34.856611  498373 driver.go:343] Setting default libvirt URI to qemu:///system
	W0915 18:41:34.856641  498373 start.go:659] api.Load failed for download-only-20210915184125-498219: filestore "download-only-20210915184125-498219": Docker machine "download-only-20210915184125-498219" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0915 18:41:34.907410  498373 docker.go:132] docker version: linux-19.03.15
	I0915 18:41:34.907493  498373 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 18:41:34.984626  498373 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:22 OomKillDisable:true NGoroutines:35 SystemTime:2021-09-15 18:41:34.940934153 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 18:41:34.984745  498373 docker.go:237] overlay module found
	I0915 18:41:34.987103  498373 start.go:278] selected driver: docker
	I0915 18:41:34.987117  498373 start.go:751] validating driver "docker" against &{Name:download-only-20210915184125-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.14.0 ClusterName:download-only-20210915184125-498219 Namespace:default
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 18:41:34.987617  498373 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 18:41:35.065381  498373 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:22 OomKillDisable:true NGoroutines:35 SystemTime:2021-09-15 18:41:35.021250527 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 18:41:35.065887  498373 cni.go:93] Creating CNI manager for ""
	I0915 18:41:35.065907  498373 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet
	I0915 18:41:35.065917  498373 start_flags.go:278] config:
	{Name:download-only-20210915184125-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:download-only-20210915184125-498219 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loc
al ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 18:41:35.068203  498373 cache.go:118] Beginning downloading kic base image for docker with containerd
	I0915 18:41:35.069670  498373 preload.go:131] Checking if preload exists for k8s version v1.22.1 and runtime containerd
	I0915 18:41:35.069775  498373 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon
	I0915 18:41:35.122530  498373 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4
	I0915 18:41:35.122568  498373 cache.go:57] Caching tarball of preloaded images
	I0915 18:41:35.122897  498373 preload.go:131] Checking if preload exists for k8s version v1.22.1 and runtime containerd
	I0915 18:41:35.125324  498373 preload.go:237] getting checksum for preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4 ...
	I0915 18:41:35.180907  498373 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull
	I0915 18:41:35.180941  498373 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load
	I0915 18:41:35.195124  498373 download.go:92] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4?checksum=md5:d7f622de8cf8f61f7111dcc1a55fd864 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.1-containerd-overlay2-amd64.tar.lz4
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-20210915184125-498219"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:173: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.22.1/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.22.2-rc.0/json-events (10.28s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.22.2-rc.0/json-events
aaa_download_only_test.go:70: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-20210915184125-498219 --force --alsologtostderr --kubernetes-version=v1.22.2-rc.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:70: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-20210915184125-498219 --force --alsologtostderr --kubernetes-version=v1.22.2-rc.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (10.275368289s)
--- PASS: TestDownloadOnly/v1.22.2-rc.0/json-events (10.28s)

                                                
                                    
x
+
TestDownloadOnly/v1.22.2-rc.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.22.2-rc.0/preload-exists
--- PASS: TestDownloadOnly/v1.22.2-rc.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.22.2-rc.0/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.22.2-rc.0/LogsDuration
aaa_download_only_test.go:172: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-20210915184125-498219
aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-20210915184125-498219: exit status 85 (67.405779ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------|---------|------|---------|------------|----------|
	| Command | Args | Profile | User | Version | Start Time | End Time |
	|---------|------|---------|------|---------|------------|----------|
	|---------|------|---------|------|---------|------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2021/09/15 18:41:53
	Running on machine: debian-jenkins-agent-1
	Binary: Built with gc go1.17 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0915 18:41:53.844278  498516 out.go:298] Setting OutFile to fd 1 ...
	I0915 18:41:53.844482  498516 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 18:41:53.844492  498516 out.go:311] Setting ErrFile to fd 2...
	I0915 18:41:53.844499  498516 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 18:41:53.844603  498516 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	W0915 18:41:53.844722  498516 root.go:291] Error reading config file at /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/config/config.json: open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/config/config.json: no such file or directory
	I0915 18:41:53.844852  498516 out.go:305] Setting JSON to true
	I0915 18:41:53.879847  498516 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-1","uptime":15872,"bootTime":1631715442,"procs":149,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}
	I0915 18:41:53.879937  498516 start.go:121] virtualization: kvm guest
	I0915 18:41:53.882635  498516 notify.go:169] Checking for updates...
	I0915 18:41:53.885009  498516 config.go:177] Loaded profile config "download-only-20210915184125-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	W0915 18:41:53.885072  498516 start.go:659] api.Load failed for download-only-20210915184125-498219: filestore "download-only-20210915184125-498219": Docker machine "download-only-20210915184125-498219" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0915 18:41:53.885140  498516 driver.go:343] Setting default libvirt URI to qemu:///system
	W0915 18:41:53.885180  498516 start.go:659] api.Load failed for download-only-20210915184125-498219: filestore "download-only-20210915184125-498219": Docker machine "download-only-20210915184125-498219" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0915 18:41:53.930013  498516 docker.go:132] docker version: linux-19.03.15
	I0915 18:41:53.930105  498516 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 18:41:54.009031  498516 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:22 OomKillDisable:true NGoroutines:35 SystemTime:2021-09-15 18:41:53.9649299 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddres
s:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings
:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 18:41:54.009117  498516 docker.go:237] overlay module found
	I0915 18:41:54.011180  498516 start.go:278] selected driver: docker
	I0915 18:41:54.011191  498516 start.go:751] validating driver "docker" against &{Name:download-only-20210915184125-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:download-only-20210915184125-498219 Namespace:default
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 18:41:54.011690  498516 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 18:41:54.089210  498516 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:22 OomKillDisable:true NGoroutines:35 SystemTime:2021-09-15 18:41:54.045587453 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 18:41:54.089731  498516 cni.go:93] Creating CNI manager for ""
	I0915 18:41:54.089748  498516 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet
	I0915 18:41:54.089759  498516 start_flags.go:278] config:
	{Name:download-only-20210915184125-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.2-rc.0 ClusterName:download-only-20210915184125-498219 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluste
r.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 18:41:54.092146  498516 cache.go:118] Beginning downloading kic base image for docker with containerd
	I0915 18:41:54.093709  498516 preload.go:131] Checking if preload exists for k8s version v1.22.2-rc.0 and runtime containerd
	I0915 18:41:54.093810  498516 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon
	I0915 18:41:54.164057  498516 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v12-v1.22.2-rc.0-containerd-overlay2-amd64.tar.lz4
	I0915 18:41:54.164091  498516 cache.go:57] Caching tarball of preloaded images
	I0915 18:41:54.164355  498516 preload.go:131] Checking if preload exists for k8s version v1.22.2-rc.0 and runtime containerd
	I0915 18:41:54.169263  498516 preload.go:237] getting checksum for preloaded-images-k8s-v12-v1.22.2-rc.0-containerd-overlay2-amd64.tar.lz4 ...
	I0915 18:41:54.203901  498516 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull
	I0915 18:41:54.203926  498516 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load
	I0915 18:41:54.235647  498516 download.go:92] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v12-v1.22.2-rc.0-containerd-overlay2-amd64.tar.lz4?checksum=md5:45555d0b6a95b49b59ececf9f7339784 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.2-rc.0-containerd-overlay2-amd64.tar.lz4
	I0915 18:42:01.312767  498516 preload.go:247] saving checksum for preloaded-images-k8s-v12-v1.22.2-rc.0-containerd-overlay2-amd64.tar.lz4 ...
	I0915 18:42:01.312873  498516 preload.go:254] verifying checksumm of /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.2-rc.0-containerd-overlay2-amd64.tar.lz4 ...
	I0915 18:42:03.493532  498516 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.2-rc.0 on containerd
	I0915 18:42:03.493707  498516 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/download-only-20210915184125-498219/config.json ...
	I0915 18:42:03.493937  498516 preload.go:131] Checking if preload exists for k8s version v1.22.2-rc.0 and runtime containerd
	I0915 18:42:03.494219  498516 download.go:92] Downloading: https://storage.googleapis.com/kubernetes-release/release/v1.22.2-rc.0/bin/linux/amd64/kubectl?checksum=file:https://storage.googleapis.com/kubernetes-release/release/v1.22.2-rc.0/bin/linux/amd64/kubectl.sha256 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/linux/v1.22.2-rc.0/kubectl
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-20210915184125-498219"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:173: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.22.2-rc.0/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAll (0.38s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAll
aaa_download_only_test.go:190: (dbg) Run:  out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.38s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAlwaysSucceeds (0.23s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:202: (dbg) Run:  out/minikube-linux-amd64 delete -p download-only-20210915184125-498219
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.23s)

                                                
                                    
x
+
TestDownloadOnlyKic (9.57s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:227: (dbg) Run:  out/minikube-linux-amd64 start --download-only -p download-docker-20210915184204-498219 --force --alsologtostderr --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:227: (dbg) Done: out/minikube-linux-amd64 start --download-only -p download-docker-20210915184204-498219 --force --alsologtostderr --driver=docker  --container-runtime=containerd: (7.337244622s)
helpers_test.go:176: Cleaning up "download-docker-20210915184204-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p download-docker-20210915184204-498219
--- PASS: TestDownloadOnlyKic (9.57s)

                                                
                                    
x
+
TestOffline (284.23s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:56: (dbg) Run:  out/minikube-linux-amd64 start -p offline-containerd-20210915191717-498219 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:56: (dbg) Done: out/minikube-linux-amd64 start -p offline-containerd-20210915191717-498219 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=containerd: (4m38.749715284s)
helpers_test.go:176: Cleaning up "offline-containerd-20210915191717-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p offline-containerd-20210915191717-498219
helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p offline-containerd-20210915191717-498219: (5.483755123s)
--- PASS: TestOffline (284.23s)

                                                
                                    
x
+
TestAddons/Setup (131.28s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:80: (dbg) Run:  out/minikube-linux-amd64 start -p addons-20210915184214-498219 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=olm --addons=volumesnapshots --addons=csi-hostpath-driver --driver=docker  --container-runtime=containerd --addons=ingress --addons=helm-tiller
addons_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -p addons-20210915184214-498219 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=olm --addons=volumesnapshots --addons=csi-hostpath-driver --driver=docker  --container-runtime=containerd --addons=ingress --addons=helm-tiller: (1m44.734992426s)
addons_test.go:89: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184214-498219 addons enable gcp-auth
addons_test.go:89: (dbg) Done: out/minikube-linux-amd64 -p addons-20210915184214-498219 addons enable gcp-auth: (14.300025952s)
addons_test.go:99: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184214-498219 addons enable gcp-auth --force
addons_test.go:99: (dbg) Done: out/minikube-linux-amd64 -p addons-20210915184214-498219 addons enable gcp-auth --force: (12.241051491s)
--- PASS: TestAddons/Setup (131.28s)

                                                
                                    
x
+
TestAddons/parallel/Registry (16.7s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:253: registry stabilized in 94.861574ms

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:255: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

                                                
                                                
=== CONT  TestAddons/parallel/Registry
helpers_test.go:343: "registry-mbsgs" [33de5b8d-cbd7-4e12-9dac-b8e4ccb0290c] Running

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:255: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.013158019s
addons_test.go:258: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:343: "registry-proxy-9s7gc" [053e0ee0-429b-41f8-916a-4d71fd74566a] Running

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:258: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.00762788s
addons_test.go:263: (dbg) Run:  kubectl --context addons-20210915184214-498219 delete po -l run=registry-test --now
addons_test.go:268: (dbg) Run:  kubectl --context addons-20210915184214-498219 run --rm registry-test --restart=Never --image=busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:268: (dbg) Done: kubectl --context addons-20210915184214-498219 run --rm registry-test --restart=Never --image=busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (5.774218329s)
addons_test.go:282: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184214-498219 ip
2021/09/15 18:44:42 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:311: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184214-498219 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (16.70s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (46.47s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:170: (dbg) Run:  kubectl --context addons-20210915184214-498219 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:177: (dbg) Run:  kubectl --context addons-20210915184214-498219 replace --force -f testdata/nginx-ingv1.yaml
addons_test.go:190: (dbg) Run:  kubectl --context addons-20210915184214-498219 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:195: (dbg) TestAddons/parallel/Ingress: waiting 4m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:343: "nginx" [1fdb3a6d-7472-4bcd-92e1-4c47867b802b] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
helpers_test.go:343: "nginx" [1fdb3a6d-7472-4bcd-92e1-4c47867b802b] Running

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:195: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 16.006309078s
addons_test.go:215: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184214-498219 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:234: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184214-498219 addons disable ingress --alsologtostderr -v=1

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:234: (dbg) Done: out/minikube-linux-amd64 -p addons-20210915184214-498219 addons disable ingress --alsologtostderr -v=1: (29.162575941s)
--- PASS: TestAddons/parallel/Ingress (46.47s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.64s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:330: metrics-server stabilized in 41.555787ms
addons_test.go:332: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:343: "metrics-server-77c99ccb96-qncqh" [eb95978d-136d-4493-bf1e-5047542ecc3e] Running

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:332: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.051774871s
addons_test.go:338: (dbg) Run:  kubectl --context addons-20210915184214-498219 top pods -n kube-system
addons_test.go:355: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184214-498219 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.64s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (9.32s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:379: tiller-deploy stabilized in 95.322482ms

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:381: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
helpers_test.go:343: "tiller-deploy-7d9fb5c894-nwblp" [16a6acb1-b5b5-41d4-a74a-6b50cf3b96d8] Running

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:381: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.010776158s
addons_test.go:396: (dbg) Run:  kubectl --context addons-20210915184214-498219 run --rm helm-test --restart=Never --image=alpine/helm:2.16.3 -it --namespace=kube-system -- version

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:396: (dbg) Done: kubectl --context addons-20210915184214-498219 run --rm helm-test --restart=Never --image=alpine/helm:2.16.3 -it --namespace=kube-system -- version: (3.83540107s)
addons_test.go:413: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184214-498219 addons disable helm-tiller --alsologtostderr -v=1
--- PASS: TestAddons/parallel/HelmTiller (9.32s)

                                                
                                    
x
+
TestAddons/parallel/Olm (35.57s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:425: (dbg) Run:  kubectl --context addons-20210915184214-498219 wait --for=condition=ready --namespace=olm pod --selector=app=catalog-operator --timeout=90s
addons_test.go:428: catalog-operator stabilized in 79.063048ms
addons_test.go:430: (dbg) Run:  kubectl --context addons-20210915184214-498219 wait --for=condition=ready --namespace=olm pod --selector=app=olm-operator --timeout=90s
addons_test.go:433: olm-operator stabilized in 143.253858ms
addons_test.go:435: (dbg) Run:  kubectl --context addons-20210915184214-498219 wait --for=condition=ready --namespace=olm pod --selector=app=packageserver --timeout=90s
addons_test.go:438: packageserver stabilized in 211.768735ms
addons_test.go:440: (dbg) Run:  kubectl --context addons-20210915184214-498219 wait --for=condition=ready --namespace=olm pod --selector=olm.catalogSource=operatorhubio-catalog --timeout=90s
addons_test.go:443: operatorhubio-catalog stabilized in 272.807963ms
addons_test.go:446: (dbg) Run:  kubectl --context addons-20210915184214-498219 create -f testdata/etcd.yaml
addons_test.go:453: (dbg) Run:  kubectl --context addons-20210915184214-498219 get csv -n my-etcd
addons_test.go:458: kubectl --context addons-20210915184214-498219 get csv -n my-etcd: unexpected stderr: No resources found in my-etcd namespace.

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:453: (dbg) Run:  kubectl --context addons-20210915184214-498219 get csv -n my-etcd

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:458: kubectl --context addons-20210915184214-498219 get csv -n my-etcd: unexpected stderr: No resources found in my-etcd namespace.

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:453: (dbg) Run:  kubectl --context addons-20210915184214-498219 get csv -n my-etcd
addons_test.go:458: kubectl --context addons-20210915184214-498219 get csv -n my-etcd: unexpected stderr: No resources found in my-etcd namespace.

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:453: (dbg) Run:  kubectl --context addons-20210915184214-498219 get csv -n my-etcd
addons_test.go:458: kubectl --context addons-20210915184214-498219 get csv -n my-etcd: unexpected stderr: No resources found in my-etcd namespace.

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:453: (dbg) Run:  kubectl --context addons-20210915184214-498219 get csv -n my-etcd

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:453: (dbg) Run:  kubectl --context addons-20210915184214-498219 get csv -n my-etcd
--- PASS: TestAddons/parallel/Olm (35.57s)

                                                
                                    
x
+
TestAddons/parallel/CSI (44.59s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:484: csi-hostpath-driver pods stabilized in 97.619343ms
addons_test.go:487: (dbg) Run:  kubectl --context addons-20210915184214-498219 create -f testdata/csi-hostpath-driver/pvc.yaml

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:492: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:393: (dbg) Run:  kubectl --context addons-20210915184214-498219 get pvc hpvc -o jsonpath={.status.phase} -n default

                                                
                                                
=== CONT  TestAddons/parallel/CSI
helpers_test.go:393: (dbg) Run:  kubectl --context addons-20210915184214-498219 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:497: (dbg) Run:  kubectl --context addons-20210915184214-498219 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:502: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:343: "task-pv-pod" [c60c14ec-9045-4cea-b972-af2dd31b4cef] Pending
helpers_test.go:343: "task-pv-pod" [c60c14ec-9045-4cea-b972-af2dd31b4cef] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

                                                
                                                
=== CONT  TestAddons/parallel/CSI
helpers_test.go:343: "task-pv-pod" [c60c14ec-9045-4cea-b972-af2dd31b4cef] Running

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:502: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 17.086908898s
addons_test.go:507: (dbg) Run:  kubectl --context addons-20210915184214-498219 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:512: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:418: (dbg) Run:  kubectl --context addons-20210915184214-498219 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:418: (dbg) Run:  kubectl --context addons-20210915184214-498219 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:517: (dbg) Run:  kubectl --context addons-20210915184214-498219 delete pod task-pv-pod

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:517: (dbg) Done: kubectl --context addons-20210915184214-498219 delete pod task-pv-pod: (1.269271294s)
addons_test.go:523: (dbg) Run:  kubectl --context addons-20210915184214-498219 delete pvc hpvc
addons_test.go:529: (dbg) Run:  kubectl --context addons-20210915184214-498219 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:534: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:393: (dbg) Run:  kubectl --context addons-20210915184214-498219 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:539: (dbg) Run:  kubectl --context addons-20210915184214-498219 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:544: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:343: "task-pv-pod-restore" [b01c975a-e150-40c1-9bec-655f75ca043b] Pending

                                                
                                                
=== CONT  TestAddons/parallel/CSI
helpers_test.go:343: "task-pv-pod-restore" [b01c975a-e150-40c1-9bec-655f75ca043b] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

                                                
                                                
=== CONT  TestAddons/parallel/CSI
helpers_test.go:343: "task-pv-pod-restore" [b01c975a-e150-40c1-9bec-655f75ca043b] Running

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:544: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 12.098854269s
addons_test.go:549: (dbg) Run:  kubectl --context addons-20210915184214-498219 delete pod task-pv-pod-restore
addons_test.go:549: (dbg) Done: kubectl --context addons-20210915184214-498219 delete pod task-pv-pod-restore: (1.691749483s)
addons_test.go:553: (dbg) Run:  kubectl --context addons-20210915184214-498219 delete pvc hpvc-restore
addons_test.go:557: (dbg) Run:  kubectl --context addons-20210915184214-498219 delete volumesnapshot new-snapshot-demo
addons_test.go:561: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184214-498219 addons disable csi-hostpath-driver --alsologtostderr -v=1

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:561: (dbg) Done: out/minikube-linux-amd64 -p addons-20210915184214-498219 addons disable csi-hostpath-driver --alsologtostderr -v=1: (7.304767713s)
addons_test.go:565: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184214-498219 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (44.59s)

                                                
                                    
x
+
TestAddons/parallel/GCPAuth (44.64s)

                                                
                                                
=== RUN   TestAddons/parallel/GCPAuth
=== PAUSE TestAddons/parallel/GCPAuth

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/GCPAuth

                                                
                                                
=== CONT  TestAddons/parallel/GCPAuth
addons_test.go:576: (dbg) Run:  kubectl --context addons-20210915184214-498219 create -f testdata/busybox.yaml

                                                
                                                
=== CONT  TestAddons/parallel/GCPAuth
addons_test.go:582: (dbg) TestAddons/parallel/GCPAuth: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:343: "busybox" [b559318f-2a2c-4c7d-9b06-2cfe5d9edcfc] Pending
helpers_test.go:343: "busybox" [b559318f-2a2c-4c7d-9b06-2cfe5d9edcfc] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

                                                
                                                
=== CONT  TestAddons/parallel/GCPAuth
helpers_test.go:343: "busybox" [b559318f-2a2c-4c7d-9b06-2cfe5d9edcfc] Running

                                                
                                                
=== CONT  TestAddons/parallel/GCPAuth
addons_test.go:582: (dbg) TestAddons/parallel/GCPAuth: integration-test=busybox healthy within 11.083470429s
addons_test.go:588: (dbg) Run:  kubectl --context addons-20210915184214-498219 exec busybox -- /bin/sh -c "printenv GOOGLE_APPLICATION_CREDENTIALS"
addons_test.go:625: (dbg) Run:  kubectl --context addons-20210915184214-498219 exec busybox -- /bin/sh -c "printenv GOOGLE_CLOUD_PROJECT"
addons_test.go:641: (dbg) Run:  kubectl --context addons-20210915184214-498219 apply -f testdata/private-image.yaml

                                                
                                                
=== CONT  TestAddons/parallel/GCPAuth
addons_test.go:648: (dbg) TestAddons/parallel/GCPAuth: waiting 8m0s for pods matching "integration-test=private-image" in namespace "default" ...

                                                
                                                
=== CONT  TestAddons/parallel/GCPAuth
helpers_test.go:343: "private-image-7ff9c8c74f-7cs8k" [10c363e3-8804-459c-a7fe-76cf6255d3b3] Pending / Ready:ContainersNotReady (containers with unready status: [private-image]) / ContainersReady:ContainersNotReady (containers with unready status: [private-image])

                                                
                                                
=== CONT  TestAddons/parallel/GCPAuth
helpers_test.go:343: "private-image-7ff9c8c74f-7cs8k" [10c363e3-8804-459c-a7fe-76cf6255d3b3] Running

                                                
                                                
=== CONT  TestAddons/parallel/GCPAuth
addons_test.go:648: (dbg) TestAddons/parallel/GCPAuth: integration-test=private-image healthy within 15.088346547s
addons_test.go:654: (dbg) Run:  kubectl --context addons-20210915184214-498219 apply -f testdata/private-image-eu.yaml
addons_test.go:661: (dbg) TestAddons/parallel/GCPAuth: waiting 8m0s for pods matching "integration-test=private-image-eu" in namespace "default" ...
helpers_test.go:343: "private-image-eu-5956d58f9f-kgsbb" [a86b6a19-e700-4954-8d0e-8556cfc7c7eb] Pending / Ready:ContainersNotReady (containers with unready status: [private-image-eu]) / ContainersReady:ContainersNotReady (containers with unready status: [private-image-eu])

                                                
                                                
=== CONT  TestAddons/parallel/GCPAuth
helpers_test.go:343: "private-image-eu-5956d58f9f-kgsbb" [a86b6a19-e700-4954-8d0e-8556cfc7c7eb] Running
addons_test.go:661: (dbg) TestAddons/parallel/GCPAuth: integration-test=private-image-eu healthy within 16.078189384s
addons_test.go:667: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184214-498219 addons disable gcp-auth --alsologtostderr -v=1
--- PASS: TestAddons/parallel/GCPAuth (44.64s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (20.9s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:140: (dbg) Run:  out/minikube-linux-amd64 stop -p addons-20210915184214-498219
addons_test.go:140: (dbg) Done: out/minikube-linux-amd64 stop -p addons-20210915184214-498219: (20.70375495s)
addons_test.go:144: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p addons-20210915184214-498219
addons_test.go:148: (dbg) Run:  out/minikube-linux-amd64 addons disable dashboard -p addons-20210915184214-498219
--- PASS: TestAddons/StoppedEnableDisable (20.90s)

                                                
                                    
x
+
TestCertOptions (46.56s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:48: (dbg) Run:  out/minikube-linux-amd64 start -p cert-options-20210915192322-498219 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:48: (dbg) Done: out/minikube-linux-amd64 start -p cert-options-20210915192322-498219 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd: (42.568164102s)
cert_options_test.go:59: (dbg) Run:  out/minikube-linux-amd64 -p cert-options-20210915192322-498219 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:74: (dbg) Run:  kubectl --context cert-options-20210915192322-498219 config view
helpers_test.go:176: Cleaning up "cert-options-20210915192322-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p cert-options-20210915192322-498219

                                                
                                                
=== CONT  TestCertOptions
helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p cert-options-20210915192322-498219: (3.498377522s)
--- PASS: TestCertOptions (46.56s)

                                                
                                    
x
+
TestForceSystemdFlag (57.37s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:86: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-flag-20210915192308-498219 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:86: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-flag-20210915192308-498219 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (53.60311306s)
docker_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-flag-20210915192308-498219 ssh "cat /etc/containerd/config.toml"
helpers_test.go:176: Cleaning up "force-systemd-flag-20210915192308-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-flag-20210915192308-498219

                                                
                                                
=== CONT  TestForceSystemdFlag
helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-flag-20210915192308-498219: (3.309841186s)
--- PASS: TestForceSystemdFlag (57.37s)

                                                
                                    
x
+
TestForceSystemdEnv (272.71s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:137: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-env-20210915191717-498219 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:137: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-env-20210915191717-498219 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (4m28.824327103s)
docker_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-env-20210915191717-498219 ssh "cat /etc/containerd/config.toml"
helpers_test.go:176: Cleaning up "force-systemd-env-20210915191717-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-env-20210915191717-498219

                                                
                                                
=== CONT  TestForceSystemdEnv
helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-env-20210915191717-498219: (3.397599931s)
--- PASS: TestForceSystemdEnv (272.71s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (2.88s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
=== PAUSE TestKVMDriverInstallOrUpdate

                                                
                                                

                                                
                                                
=== CONT  TestKVMDriverInstallOrUpdate
--- PASS: TestKVMDriverInstallOrUpdate (2.88s)

                                                
                                    
x
+
TestErrorSpam/setup (43.01s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:79: (dbg) Run:  out/minikube-linux-amd64 start -p nospam-20210915184556-498219 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-20210915184556-498219 --driver=docker  --container-runtime=containerd
error_spam_test.go:79: (dbg) Done: out/minikube-linux-amd64 start -p nospam-20210915184556-498219 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-20210915184556-498219 --driver=docker  --container-runtime=containerd: (43.009104904s)
error_spam_test.go:89: acceptable stderr: "! Your cgroup does not allow setting memory."
error_spam_test.go:89: acceptable stderr: "! /usr/local/bin/kubectl is version 1.20.5, which may have incompatibilites with Kubernetes 1.22.1."
--- PASS: TestErrorSpam/setup (43.01s)

                                                
                                    
x
+
TestErrorSpam/start (0.94s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:214: Cleaning up 1 logfile(s) ...
error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 start --dry-run
error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 start --dry-run
error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 start --dry-run
--- PASS: TestErrorSpam/start (0.94s)

                                                
                                    
x
+
TestErrorSpam/status (1.13s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:214: Cleaning up 0 logfile(s) ...
error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 status
error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 status
error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 status
--- PASS: TestErrorSpam/status (1.13s)

                                                
                                    
x
+
TestErrorSpam/pause (2.5s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:214: Cleaning up 0 logfile(s) ...
error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 pause
error_spam_test.go:157: (dbg) Done: out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 pause: (1.562835177s)
error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 pause
error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 pause
--- PASS: TestErrorSpam/pause (2.50s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.47s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:214: Cleaning up 0 logfile(s) ...
error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 unpause
error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 unpause
error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 unpause
--- PASS: TestErrorSpam/unpause (1.47s)

                                                
                                    
x
+
TestErrorSpam/stop (23.42s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:214: Cleaning up 0 logfile(s) ...
error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 stop
error_spam_test.go:157: (dbg) Done: out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 stop: (23.154320914s)
error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 stop
error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184556-498219 --log_dir /tmp/nospam-20210915184556-498219 stop
--- PASS: TestErrorSpam/stop (23.42s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1726: local sync path: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/test/nested/copy/498219/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (69.22s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2102: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20210915184714-498219 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd
functional_test.go:2102: (dbg) Done: out/minikube-linux-amd64 start -p functional-20210915184714-498219 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd: (1m9.222772351s)
--- PASS: TestFunctional/serial/StartWithProxy (69.22s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (15.6s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:747: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20210915184714-498219 --alsologtostderr -v=8
functional_test.go:747: (dbg) Done: out/minikube-linux-amd64 start -p functional-20210915184714-498219 --alsologtostderr -v=8: (15.595719077s)
functional_test.go:751: soft start took 15.59634332s for "functional-20210915184714-498219" cluster.
--- PASS: TestFunctional/serial/SoftStart (15.60s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:767: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.05s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.17s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:780: (dbg) Run:  kubectl --context functional-20210915184714-498219 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.17s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (3.25s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1102: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 cache add k8s.gcr.io/pause:3.1
functional_test.go:1102: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 cache add k8s.gcr.io/pause:3.3
functional_test.go:1102: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184714-498219 cache add k8s.gcr.io/pause:3.3: (1.440088728s)
functional_test.go:1102: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 cache add k8s.gcr.io/pause:latest
functional_test.go:1102: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184714-498219 cache add k8s.gcr.io/pause:latest: (1.158986505s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.25s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (2.03s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1132: (dbg) Run:  docker build -t minikube-local-cache-test:functional-20210915184714-498219 /tmp/functional-20210915184714-4982191859809546
functional_test.go:1144: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 cache add minikube-local-cache-test:functional-20210915184714-498219
functional_test.go:1144: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184714-498219 cache add minikube-local-cache-test:functional-20210915184714-498219: (1.730018602s)
functional_test.go:1149: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 cache delete minikube-local-cache-test:functional-20210915184714-498219
functional_test.go:1138: (dbg) Run:  docker rmi minikube-local-cache-test:functional-20210915184714-498219
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (2.03s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3 (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3
functional_test.go:1156: (dbg) Run:  out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3 (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1163: (dbg) Run:  out/minikube-linux-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.35s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1176: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.35s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (2.04s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1198: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh sudo crictl rmi k8s.gcr.io/pause:latest
functional_test.go:1204: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh sudo crictl inspecti k8s.gcr.io/pause:latest
functional_test.go:1204: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh sudo crictl inspecti k8s.gcr.io/pause:latest: exit status 1 (351.190096ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "k8s.gcr.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1209: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 cache reload
functional_test.go:1214: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh sudo crictl inspecti k8s.gcr.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.04s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1223: (dbg) Run:  out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:3.1
functional_test.go:1223: (dbg) Run:  out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:798: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 kubectl -- --context functional-20210915184714-498219 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.10s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:821: (dbg) Run:  out/kubectl --context functional-20210915184714-498219 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.10s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (43.51s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:835: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20210915184714-498219 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E0915 18:49:25.846486  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 18:49:25.852568  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 18:49:25.862803  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 18:49:25.883090  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 18:49:25.923422  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 18:49:26.003753  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 18:49:26.164161  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 18:49:26.484538  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 18:49:27.125487  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 18:49:28.406024  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
functional_test.go:835: (dbg) Done: out/minikube-linux-amd64 start -p functional-20210915184714-498219 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (43.510354857s)
functional_test.go:839: restart took 43.510477887s for "functional-20210915184714-498219" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (43.51s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:886: (dbg) Run:  kubectl --context functional-20210915184714-498219 get po -l tier=control-plane -n kube-system -o=json
E0915 18:49:30.966497  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
functional_test.go:900: etcd phase: Running
functional_test.go:910: etcd status: Ready
functional_test.go:900: kube-apiserver phase: Running
functional_test.go:910: kube-apiserver status: Ready
functional_test.go:900: kube-controller-manager phase: Running
functional_test.go:910: kube-controller-manager status: Ready
functional_test.go:900: kube-scheduler phase: Running
functional_test.go:910: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.07s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.05s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1285: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 logs
functional_test.go:1285: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184714-498219 logs: (1.054206663s)
--- PASS: TestFunctional/serial/LogsCmd (1.05s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.11s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1301: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 logs --file /tmp/functional-20210915184714-4982193228664185/logs.txt
functional_test.go:1301: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184714-498219 logs --file /tmp/functional-20210915184714-4982193228664185/logs.txt: (1.112985549s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.11s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1249: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 config unset cpus

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1249: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 config get cpus
functional_test.go:1249: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184714-498219 config get cpus: exit status 14 (57.95239ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1249: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 config set cpus 2
functional_test.go:1249: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 config get cpus
functional_test.go:1249: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 config unset cpus
functional_test.go:1249: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 config get cpus
functional_test.go:1249: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184714-498219 config get cpus: exit status 14 (52.182731ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (5.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:977: (dbg) daemon: [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-20210915184714-498219 --alsologtostderr -v=1]

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:982: (dbg) stopping [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-20210915184714-498219 --alsologtostderr -v=1] ...
helpers_test.go:507: unable to kill pid 532543: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (5.15s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.57s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:1039: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20210915184714-498219 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:1039: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-20210915184714-498219 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (243.773143ms)

                                                
                                                
-- stdout --
	* [functional-20210915184714-498219] minikube v1.23.0 on Debian 9.13 (kvm/amd64)
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube
	  - MINIKUBE_LOCATION=12425
	* Using the docker driver based on existing profile
	  - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0915 18:49:54.343234  531873 out.go:298] Setting OutFile to fd 1 ...
	I0915 18:49:54.343426  531873 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 18:49:54.343434  531873 out.go:311] Setting ErrFile to fd 2...
	I0915 18:49:54.343438  531873 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 18:49:54.343531  531873 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	I0915 18:49:54.343711  531873 out.go:305] Setting JSON to false
	I0915 18:49:54.382482  531873 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-1","uptime":16352,"bootTime":1631715442,"procs":254,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}
	I0915 18:49:54.382586  531873 start.go:121] virtualization: kvm guest
	I0915 18:49:54.384768  531873 out.go:177] * [functional-20210915184714-498219] minikube v1.23.0 on Debian 9.13 (kvm/amd64)
	I0915 18:49:54.386571  531873 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	I0915 18:49:54.388003  531873 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0915 18:49:54.389423  531873 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube
	I0915 18:49:54.390806  531873 out.go:177]   - MINIKUBE_LOCATION=12425
	I0915 18:49:54.391253  531873 config.go:177] Loaded profile config "functional-20210915184714-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 18:49:54.391787  531873 driver.go:343] Setting default libvirt URI to qemu:///system
	I0915 18:49:54.443227  531873 docker.go:132] docker version: linux-19.03.15
	I0915 18:49:54.443314  531873 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 18:49:54.522903  531873 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:44 SystemTime:2021-09-15 18:49:54.480233151 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 18:49:54.522975  531873 docker.go:237] overlay module found
	I0915 18:49:54.524633  531873 out.go:177] * Using the docker driver based on existing profile
	I0915 18:49:54.524672  531873 start.go:278] selected driver: docker
	I0915 18:49:54.524679  531873 start.go:751] validating driver "docker" against &{Name:functional-20210915184714-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:functional-20210915184714-498219 Namespace:default APISer
verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision} {Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false reg
istry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 18:49:54.524813  531873 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
	W0915 18:49:54.524849  531873 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.
	W0915 18:49:54.524880  531873 out.go:242] ! Your cgroup does not allow setting memory.
	! Your cgroup does not allow setting memory.
	I0915 18:49:54.526512  531873 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities
	I0915 18:49:54.528389  531873 out.go:177] 
	W0915 18:49:54.528473  531873 out.go:242] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0915 18:49:54.530114  531873 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:1054: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20210915184714-498219 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
--- PASS: TestFunctional/parallel/DryRun (0.57s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1076: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20210915184714-498219 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1076: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-20210915184714-498219 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (255.228911ms)

                                                
                                                
-- stdout --
	* [functional-20210915184714-498219] minikube v1.23.0 sur Debian 9.13 (kvm/amd64)
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube
	  - MINIKUBE_LOCATION=12425
	* Utilisation du pilote docker basé sur le profil existant
	  - Plus d'informations: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0915 18:49:54.332729  531863 out.go:298] Setting OutFile to fd 1 ...
	I0915 18:49:54.332847  531863 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 18:49:54.332854  531863 out.go:311] Setting ErrFile to fd 2...
	I0915 18:49:54.332858  531863 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 18:49:54.333015  531863 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	I0915 18:49:54.333224  531863 out.go:305] Setting JSON to false
	I0915 18:49:54.376341  531863 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-1","uptime":16352,"bootTime":1631715442,"procs":255,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}
	I0915 18:49:54.376479  531863 start.go:121] virtualization: kvm guest
	I0915 18:49:54.379380  531863 out.go:177] * [functional-20210915184714-498219] minikube v1.23.0 sur Debian 9.13 (kvm/amd64)
	I0915 18:49:54.380826  531863 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	I0915 18:49:54.382316  531863 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0915 18:49:54.383924  531863 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube
	I0915 18:49:54.385613  531863 out.go:177]   - MINIKUBE_LOCATION=12425
	I0915 18:49:54.386011  531863 config.go:177] Loaded profile config "functional-20210915184714-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 18:49:54.386384  531863 driver.go:343] Setting default libvirt URI to qemu:///system
	I0915 18:49:54.437318  531863 docker.go:132] docker version: linux-19.03.15
	I0915 18:49:54.437469  531863 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 18:49:54.521110  531863 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:30 OomKillDisable:true NGoroutines:40 SystemTime:2021-09-15 18:49:54.475490321 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 18:49:54.521226  531863 docker.go:237] overlay module found
	I0915 18:49:54.523466  531863 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0915 18:49:54.523493  531863 start.go:278] selected driver: docker
	I0915 18:49:54.523499  531863 start.go:751] validating driver "docker" against &{Name:functional-20210915184714-498219 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:functional-20210915184714-498219 Namespace:default APISer
verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision} {Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false reg
istry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
	I0915 18:49:54.523632  531863 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
	W0915 18:49:54.523675  531863 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.
	W0915 18:49:54.523692  531863 out.go:242] ! Votre groupe de contrôle ne permet pas de définir la mémoire.
	! Votre groupe de contrôle ne permet pas de définir la mémoire.
	I0915 18:49:54.525494  531863 out.go:177]   - Plus d'informations: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities
	I0915 18:49:54.527351  531863 out.go:177] 
	W0915 18:49:54.527459  531863 out.go:242] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0915 18:49:54.529271  531863 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:929: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 status

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:935: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:946: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.30s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd (18.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd
=== PAUSE TestFunctional/parallel/ServiceCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
functional_test.go:1477: (dbg) Run:  kubectl --context functional-20210915184714-498219 create deployment hello-node --image=k8s.gcr.io/echoserver:1.8
functional_test.go:1483: (dbg) Run:  kubectl --context functional-20210915184714-498219 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1488: (dbg) TestFunctional/parallel/ServiceCmd: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:343: "hello-node-6cbfcd7cbc-f8c9x" [060bacc9-0dbd-4da1-89ce-ce8385bb97a1] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
helpers_test.go:343: "hello-node-6cbfcd7cbc-f8c9x" [060bacc9-0dbd-4da1-89ce-ce8385bb97a1] Running

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
functional_test.go:1488: (dbg) TestFunctional/parallel/ServiceCmd: app=hello-node healthy within 16.006343567s
functional_test.go:1492: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 service list

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
functional_test.go:1505: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 service --namespace=default --https --url hello-node

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
functional_test.go:1514: found endpoint: https://192.168.49.2:30817
functional_test.go:1525: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 service hello-node --url --format={{.IP}}

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
functional_test.go:1534: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 service hello-node --url

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmd
functional_test.go:1540: found endpoint for hello-node: http://192.168.49.2:30817
functional_test.go:1551: Attempting to fetch http://192.168.49.2:30817 ...
functional_test.go:1570: http://192.168.49.2:30817: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-6cbfcd7cbc-f8c9x

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:30817
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmd (18.11s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1585: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 addons list
E0915 18:49:36.087117  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
functional_test.go:1596: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (30.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:45: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:343: "storage-provisioner" [9b083d94-cf5a-481c-9291-b20602aa2c7d] Running

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:45: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.007717558s
functional_test_pvc_test.go:50: (dbg) Run:  kubectl --context functional-20210915184714-498219 get storageclass -o=json
functional_test_pvc_test.go:70: (dbg) Run:  kubectl --context functional-20210915184714-498219 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:77: (dbg) Run:  kubectl --context functional-20210915184714-498219 get pvc myclaim -o=json
functional_test_pvc_test.go:126: (dbg) Run:  kubectl --context functional-20210915184714-498219 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:131: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:343: "sp-pod" [260c62f7-aabf-422b-89ba-54ff8bf5cf46] Pending
helpers_test.go:343: "sp-pod" [260c62f7-aabf-422b-89ba-54ff8bf5cf46] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
helpers_test.go:343: "sp-pod" [260c62f7-aabf-422b-89ba-54ff8bf5cf46] Running

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:131: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 14.009854672s
functional_test_pvc_test.go:101: (dbg) Run:  kubectl --context functional-20210915184714-498219 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:107: (dbg) Run:  kubectl --context functional-20210915184714-498219 delete -f testdata/storage-provisioner/pod.yaml

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:107: (dbg) Done: kubectl --context functional-20210915184714-498219 delete -f testdata/storage-provisioner/pod.yaml: (1.107021954s)
functional_test_pvc_test.go:126: (dbg) Run:  kubectl --context functional-20210915184714-498219 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:131: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:343: "sp-pod" [5197d982-450a-42a5-9be4-574d07ba9118] Pending
helpers_test.go:343: "sp-pod" [5197d982-450a-42a5-9be4-574d07ba9118] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
helpers_test.go:343: "sp-pod" [5197d982-450a-42a5-9be4-574d07ba9118] Running

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:131: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 9.006670461s
functional_test_pvc_test.go:115: (dbg) Run:  kubectl --context functional-20210915184714-498219 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (30.18s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.82s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1618: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "echo hello"

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1635: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.82s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (0.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:535: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 cp testdata/cp-test.txt /home/docker/cp-test.txt

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:549: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo cat /home/docker/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (0.73s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (18.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1666: (dbg) Run:  kubectl --context functional-20210915184714-498219 replace --force -f testdata/mysql.yaml

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1671: (dbg) TestFunctional/parallel/MySQL: waiting 10m0s for pods matching "app=mysql" in namespace "default" ...

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
helpers_test.go:343: "mysql-9bbbc5bbb-86tsv" [8ef417a5-662d-4bd9-90d2-2e936d55d0e7] Pending / Ready:ContainersNotReady (containers with unready status: [mysql]) / ContainersReady:ContainersNotReady (containers with unready status: [mysql])

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
helpers_test.go:343: "mysql-9bbbc5bbb-86tsv" [8ef417a5-662d-4bd9-90d2-2e936d55d0e7] Running

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1671: (dbg) TestFunctional/parallel/MySQL: app=mysql healthy within 14.012288572s
functional_test.go:1678: (dbg) Run:  kubectl --context functional-20210915184714-498219 exec mysql-9bbbc5bbb-86tsv -- mysql -ppassword -e "show databases;"
functional_test.go:1678: (dbg) Non-zero exit: kubectl --context functional-20210915184714-498219 exec mysql-9bbbc5bbb-86tsv -- mysql -ppassword -e "show databases;": exit status 1 (143.341886ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
	command terminated with exit code 1

                                                
                                                
** /stderr **
functional_test.go:1678: (dbg) Run:  kubectl --context functional-20210915184714-498219 exec mysql-9bbbc5bbb-86tsv -- mysql -ppassword -e "show databases;"
functional_test.go:1678: (dbg) Non-zero exit: kubectl --context functional-20210915184714-498219 exec mysql-9bbbc5bbb-86tsv -- mysql -ppassword -e "show databases;": exit status 1 (219.700251ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
	command terminated with exit code 1

                                                
                                                
** /stderr **
functional_test.go:1678: (dbg) Run:  kubectl --context functional-20210915184714-498219 exec mysql-9bbbc5bbb-86tsv -- mysql -ppassword -e "show databases;"
functional_test.go:1678: (dbg) Non-zero exit: kubectl --context functional-20210915184714-498219 exec mysql-9bbbc5bbb-86tsv -- mysql -ppassword -e "show databases;": exit status 1 (239.297911ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
	command terminated with exit code 1

                                                
                                                
** /stderr **

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1678: (dbg) Run:  kubectl --context functional-20210915184714-498219 exec mysql-9bbbc5bbb-86tsv -- mysql -ppassword -e "show databases;"
--- PASS: TestFunctional/parallel/MySQL (18.24s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1798: Checking for existence of /etc/test/nested/copy/498219/hosts within VM
functional_test.go:1799: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo cat /etc/test/nested/copy/498219/hosts"

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1804: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.40s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1839: Checking for existence of /etc/ssl/certs/498219.pem within VM

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1840: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo cat /etc/ssl/certs/498219.pem"

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1839: Checking for existence of /usr/share/ca-certificates/498219.pem within VM
functional_test.go:1840: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo cat /usr/share/ca-certificates/498219.pem"

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1839: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1840: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo cat /etc/ssl/certs/51391683.0"

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1866: Checking for existence of /etc/ssl/certs/4982192.pem within VM
functional_test.go:1867: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo cat /etc/ssl/certs/4982192.pem"

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1866: Checking for existence of /usr/share/ca-certificates/4982192.pem within VM
functional_test.go:1867: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo cat /usr/share/ca-certificates/4982192.pem"

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1866: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1867: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.39s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-20210915184714-498219 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/LoadImage (2.58s)

                                                
                                                
=== RUN   TestFunctional/parallel/LoadImage
=== PAUSE TestFunctional/parallel/LoadImage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/LoadImage
functional_test.go:241: (dbg) Run:  docker pull busybox:1.33

                                                
                                                
=== CONT  TestFunctional/parallel/LoadImage
functional_test.go:241: (dbg) Done: docker pull busybox:1.33: (1.214266623s)
functional_test.go:248: (dbg) Run:  docker tag busybox:1.33 docker.io/library/busybox:load-functional-20210915184714-498219
functional_test.go:254: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 image load --daemon docker.io/library/busybox:load-functional-20210915184714-498219

                                                
                                                
=== CONT  TestFunctional/parallel/LoadImage
functional_test.go:470: (dbg) Run:  out/minikube-linux-amd64 ssh -p functional-20210915184714-498219 -- sudo crictl inspecti docker.io/library/busybox:load-functional-20210915184714-498219
--- PASS: TestFunctional/parallel/LoadImage (2.58s)

                                                
                                    
x
+
TestFunctional/parallel/SaveImage (3.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/SaveImage
=== PAUSE TestFunctional/parallel/SaveImage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SaveImage
functional_test.go:379: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 image pull docker.io/library/busybox:1.29

                                                
                                                
=== CONT  TestFunctional/parallel/SaveImage
functional_test.go:379: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184714-498219 image pull docker.io/library/busybox:1.29: (2.317191507s)
functional_test.go:388: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 image tag docker.io/library/busybox:1.29 docker.io/library/busybox:save-functional-20210915184714-498219

                                                
                                                
=== CONT  TestFunctional/parallel/SaveImage
functional_test.go:394: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 image save --daemon docker.io/library/busybox:save-functional-20210915184714-498219

                                                
                                                
=== CONT  TestFunctional/parallel/SaveImage
functional_test.go:400: (dbg) Run:  docker images busybox
--- PASS: TestFunctional/parallel/SaveImage (3.50s)

                                                
                                    
x
+
TestFunctional/parallel/RemoveImage (2.87s)

                                                
                                                
=== RUN   TestFunctional/parallel/RemoveImage
=== PAUSE TestFunctional/parallel/RemoveImage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/RemoveImage

                                                
                                                
=== CONT  TestFunctional/parallel/RemoveImage
functional_test.go:333: (dbg) Run:  docker pull busybox:1.32

                                                
                                                
=== CONT  TestFunctional/parallel/RemoveImage
functional_test.go:333: (dbg) Done: docker pull busybox:1.32: (1.22569856s)
functional_test.go:340: (dbg) Run:  docker tag busybox:1.32 docker.io/library/busybox:remove-functional-20210915184714-498219
functional_test.go:346: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 image load docker.io/library/busybox:remove-functional-20210915184714-498219

                                                
                                                
=== CONT  TestFunctional/parallel/RemoveImage
functional_test.go:352: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 image rm docker.io/library/busybox:remove-functional-20210915184714-498219

                                                
                                                
=== CONT  TestFunctional/parallel/RemoveImage
functional_test.go:484: (dbg) Run:  out/minikube-linux-amd64 ssh -p functional-20210915184714-498219 -- sudo crictl images
--- PASS: TestFunctional/parallel/RemoveImage (2.87s)

                                                
                                    
x
+
TestFunctional/parallel/LoadImageFromFile (2.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/LoadImageFromFile
=== PAUSE TestFunctional/parallel/LoadImageFromFile

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/LoadImageFromFile
functional_test.go:281: (dbg) Run:  docker pull busybox:1.31

                                                
                                                
=== CONT  TestFunctional/parallel/LoadImageFromFile
functional_test.go:281: (dbg) Done: docker pull busybox:1.31: (1.421446594s)
functional_test.go:288: (dbg) Run:  docker tag busybox:1.31 docker.io/library/busybox:load-from-file-functional-20210915184714-498219
functional_test.go:295: (dbg) Run:  docker save -o busybox-load.tar docker.io/library/busybox:load-from-file-functional-20210915184714-498219
functional_test.go:306: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 image load /home/jenkins/workspace/Docker_Linux_containerd_integration/busybox-load.tar

                                                
                                                
=== CONT  TestFunctional/parallel/LoadImageFromFile
functional_test.go:484: (dbg) Run:  out/minikube-linux-amd64 ssh -p functional-20210915184714-498219 -- sudo crictl images
--- PASS: TestFunctional/parallel/LoadImageFromFile (2.37s)

                                                
                                    
x
+
TestFunctional/parallel/SaveImageToFile (3.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/SaveImageToFile
=== PAUSE TestFunctional/parallel/SaveImageToFile

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SaveImageToFile
functional_test.go:421: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 image pull docker.io/library/busybox:1.30

                                                
                                                
=== CONT  TestFunctional/parallel/SaveImageToFile
functional_test.go:421: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184714-498219 image pull docker.io/library/busybox:1.30: (2.300191165s)
functional_test.go:429: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 image tag docker.io/library/busybox:1.30 docker.io/library/busybox:save-to-file-functional-20210915184714-498219

                                                
                                                
=== CONT  TestFunctional/parallel/SaveImageToFile
functional_test.go:440: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 image save docker.io/library/busybox:save-to-file-functional-20210915184714-498219 /home/jenkins/workspace/Docker_Linux_containerd_integration/busybox-save.tar
functional_test.go:446: (dbg) Run:  docker load -i /home/jenkins/workspace/Docker_Linux_containerd_integration/busybox-save.tar
functional_test.go:453: (dbg) Run:  docker images busybox
--- PASS: TestFunctional/parallel/SaveImageToFile (3.45s)

                                                
                                    
x
+
TestFunctional/parallel/BuildImage (3.63s)

                                                
                                                
=== RUN   TestFunctional/parallel/BuildImage
=== PAUSE TestFunctional/parallel/BuildImage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/BuildImage
functional_test.go:504: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 image build -t localhost/my-image:functional-20210915184714-498219 testdata/build

                                                
                                                
=== CONT  TestFunctional/parallel/BuildImage
functional_test.go:504: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184714-498219 image build -t localhost/my-image:functional-20210915184714-498219 testdata/build: (3.269980444s)
functional_test.go:512: (dbg) Stderr: out/minikube-linux-amd64 -p functional-20210915184714-498219 image build -t localhost/my-image:functional-20210915184714-498219 testdata/build:
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 77B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s

                                                
                                                
#3 [internal] load metadata for docker.io/library/busybox:latest
#3 DONE 1.3s

                                                
                                                
#6 [internal] load build context
#6 transferring context: 62B done
#6 DONE 0.0s

                                                
                                                
#4 [1/3] FROM docker.io/library/busybox@sha256:52f73a0a43a16cf37cd0720c90887ce972fe60ee06a687ee71fb93a7ca601df7
#4 resolve docker.io/library/busybox@sha256:52f73a0a43a16cf37cd0720c90887ce972fe60ee06a687ee71fb93a7ca601df7 0.0s done
#4 DONE 0.0s

                                                
                                                
#5 [2/3] RUN true
#5 DONE 0.3s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.1s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.1s done
#8 exporting manifest sha256:b8597a72d3a898a5c169eec67b7b3e880c5b53ae7c5813a6fafb5ae3691257fc done
#8 exporting config sha256:871c6abf5db03a1ba3738e377d4b795e45878555628b8deecea7893dd2ea13d9 done
#8 naming to localhost/my-image:functional-20210915184714-498219 done
#8 DONE 0.1s
functional_test.go:470: (dbg) Run:  out/minikube-linux-amd64 ssh -p functional-20210915184714-498219 -- sudo crictl inspecti localhost/my-image:functional-20210915184714-498219
--- PASS: TestFunctional/parallel/BuildImage (3.63s)

                                                
                                    
x
+
TestFunctional/parallel/ListImages (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/ListImages
=== PAUSE TestFunctional/parallel/ListImages

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ListImages
functional_test.go:538: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 image ls

                                                
                                                
=== CONT  TestFunctional/parallel/ListImages
functional_test.go:543: (dbg) Stdout: out/minikube-linux-amd64 -p functional-20210915184714-498219 image ls:
k8s.gcr.io/pause:latest
k8s.gcr.io/pause:3.5
k8s.gcr.io/pause:3.3
k8s.gcr.io/pause:3.1
k8s.gcr.io/kube-scheduler:v1.22.1
k8s.gcr.io/kube-proxy:v1.22.1
k8s.gcr.io/kube-controller-manager:v1.22.1
k8s.gcr.io/kube-apiserver:v1.22.1
k8s.gcr.io/etcd:3.5.0-0
k8s.gcr.io/echoserver:1.8
k8s.gcr.io/coredns/coredns:v1.8.4
gcr.io/k8s-minikube/storage-provisioner:v5
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/mysql:5.7
docker.io/library/minikube-local-cache-test:functional-20210915184714-498219
docker.io/kubernetesui/metrics-scraper:v1.0.4
docker.io/kubernetesui/dashboard:v2.1.0
docker.io/kindest/kindnetd:v20210326-1e038dc5
--- PASS: TestFunctional/parallel/ListImages (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.94s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:1894: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo systemctl is-active docker"

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:1894: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo systemctl is-active docker": exit status 1 (547.748431ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:1894: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo systemctl is-active crio"
functional_test.go:1894: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo systemctl is-active crio": exit status 1 (394.190042ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.94s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:127: (dbg) daemon: [out/minikube-linux-amd64 -p functional-20210915184714-498219 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (16.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:147: (dbg) Run:  kubectl --context functional-20210915184714-498219 apply -f testdata/testsvc.yaml

                                                
                                                
=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:151: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:343: "nginx-svc" [07f53620-7bd9-4f6f-a9e7-1c48e8a4320a] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

                                                
                                                
=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
helpers_test.go:343: "nginx-svc" [07f53620-7bd9-4f6f-a9e7-1c48e8a4320a] Running
E0915 18:49:46.327966  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory

                                                
                                                
=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:151: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 16.0093349s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (16.22s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20210915184714-498219 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:234: tunnel at http://10.102.53.141 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:369: (dbg) stopping [out/minikube-linux-amd64 -p functional-20210915184714-498219 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1322: (dbg) Run:  out/minikube-linux-amd64 profile lis
functional_test.go:1326: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (7.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:77: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-20210915184714-498219 /tmp/mounttest3997371288:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:111: wrote "test-1631731791771473114" to /tmp/mounttest3997371288/created-by-test
functional_test_mount_test.go:111: wrote "test-1631731791771473114" to /tmp/mounttest3997371288/created-by-test-removed-by-pod
functional_test_mount_test.go:111: wrote "test-1631731791771473114" to /tmp/mounttest3997371288/test-1631731791771473114
functional_test_mount_test.go:119: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "findmnt -T /mount-9p | grep 9p"

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:119: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (379.54726ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:119: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "findmnt -T /mount-9p | grep 9p"

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:133: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh -- ls -la /mount-9p

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:137: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Sep 15 18:49 created-by-test
-rw-r--r-- 1 docker docker 24 Sep 15 18:49 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Sep 15 18:49 test-1631731791771473114
functional_test_mount_test.go:141: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh cat /mount-9p/test-1631731791771473114

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:152: (dbg) Run:  kubectl --context functional-20210915184714-498219 replace --force -f testdata/busybox-mount-test.yaml

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:157: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:343: "busybox-mount" [6785aa3a-c2ff-4fb8-819a-e419bd892963] Pending

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
helpers_test.go:343: "busybox-mount" [6785aa3a-c2ff-4fb8-819a-e419bd892963] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
helpers_test.go:343: "busybox-mount" [6785aa3a-c2ff-4fb8-819a-e419bd892963] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:157: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.006019943s
functional_test_mount_test.go:173: (dbg) Run:  kubectl --context functional-20210915184714-498219 logs busybox-mount
functional_test_mount_test.go:185: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh stat /mount-9p/created-by-test

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:185: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh stat /mount-9p/created-by-pod

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:94: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:98: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-20210915184714-498219 /tmp/mounttest3997371288:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (7.68s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1360: (dbg) Run:  out/minikube-linux-amd64 profile list

                                                
                                                
=== CONT  TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1365: Took "395.299213ms" to run "out/minikube-linux-amd64 profile list"
functional_test.go:1374: (dbg) Run:  out/minikube-linux-amd64 profile list -l
functional_test.go:1379: Took "55.470526ms" to run "out/minikube-linux-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.45s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.52s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1410: (dbg) Run:  out/minikube-linux-amd64 profile list -o json

                                                
                                                
=== CONT  TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1415: Took "460.495431ms" to run "out/minikube-linux-amd64 profile list -o json"
functional_test.go:1423: (dbg) Run:  out/minikube-linux-amd64 profile list -o json --light

                                                
                                                
=== CONT  TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1428: Took "63.406687ms" to run "out/minikube-linux-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.52s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2123: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 version --short
--- PASS: TestFunctional/parallel/Version/short (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2136: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.54s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (2.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:226: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-20210915184714-498219 /tmp/mounttest2200405863:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:256: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "findmnt -T /mount-9p | grep 9p"
2021/09/15 18:49:59 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:256: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (401.063285ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:256: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "findmnt -T /mount-9p | grep 9p"

                                                
                                                
=== CONT  TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:270: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh -- ls -la /mount-9p
functional_test_mount_test.go:274: guest mount directory contents
total 0
functional_test_mount_test.go:276: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-20210915184714-498219 /tmp/mounttest2200405863:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:277: reading mount text
functional_test_mount_test.go:291: done reading mount text
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh "sudo umount -f /mount-9p": exit status 1 (391.26724ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:245: "out/minikube-linux-amd64 -p functional-20210915184714-498219 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:247: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-20210915184714-498219 /tmp/mounttest2200405863:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.37s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:1985: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.19s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:1985: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:1985: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184714-498219 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.20s)

                                                
                                    
x
+
TestFunctional/delete_busybox_image (0.09s)

                                                
                                                
=== RUN   TestFunctional/delete_busybox_image
functional_test.go:186: (dbg) Run:  docker rmi -f docker.io/library/busybox:load-functional-20210915184714-498219
functional_test.go:191: (dbg) Run:  docker rmi -f docker.io/library/busybox:remove-functional-20210915184714-498219
--- PASS: TestFunctional/delete_busybox_image (0.09s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.04s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:198: (dbg) Run:  docker rmi -f localhost/my-image:functional-20210915184714-498219
--- PASS: TestFunctional/delete_my-image_image (0.04s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.04s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:206: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-20210915184714-498219
--- PASS: TestFunctional/delete_minikube_cached_images (0.04s)

                                                
                                    
x
+
TestJSONOutput/start/Command (66.85s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-20210915185009-498219 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd
E0915 18:50:47.770171  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 start -p json-output-20210915185009-498219 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd: (1m6.844257355s)
--- PASS: TestJSONOutput/start/Command (66.85s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.63s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 pause -p json-output-20210915185009-498219 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.63s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.62s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 unpause -p json-output-20210915185009-498219 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.62s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (24.23s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 stop -p json-output-20210915185009-498219 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 stop -p json-output-20210915185009-498219 --output=json --user=testUser: (24.228852553s)
--- PASS: TestJSONOutput/stop/Command (24.23s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.34s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:149: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-error-20210915185146-498219 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:149: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p json-output-error-20210915185146-498219 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (92.939283ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"8b38298c-0469-4727-8244-9fbd319a0c25","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-20210915185146-498219] minikube v1.23.0 on Debian 9.13 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"ac108239-135f-4a7d-9ac3-979c6186dd9e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig"}}
	{"specversion":"1.0","id":"6eeedcfe-2953-4088-abdf-18bd912e9775","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
	{"specversion":"1.0","id":"0bd32caa-2b90-43af-ba61-6ede94fb6b9a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube"}}
	{"specversion":"1.0","id":"ef68ad4b-4c1f-4b43-8e68-c0f6ddc4670d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=12425"}}
	{"specversion":"1.0","id":"11f5c49d-be69-45de-ad5b-381f68938f9a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:176: Cleaning up "json-output-error-20210915185146-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p json-output-error-20210915185146-498219
--- PASS: TestErrorJSONOutput (0.34s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (27.67s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:58: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-20210915185147-498219 --network=
E0915 18:52:09.690844  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
kic_custom_network_test.go:58: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-20210915185147-498219 --network=: (25.186516954s)
kic_custom_network_test.go:102: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:176: Cleaning up "docker-network-20210915185147-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-20210915185147-498219
helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-20210915185147-498219: (2.445393142s)
--- PASS: TestKicCustomNetwork/create_custom_network (27.67s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (24.66s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:58: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-20210915185214-498219 --network=bridge
kic_custom_network_test.go:58: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-20210915185214-498219 --network=bridge: (22.296112141s)
kic_custom_network_test.go:102: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:176: Cleaning up "docker-network-20210915185214-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-20210915185214-498219
helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-20210915185214-498219: (2.325185758s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (24.66s)

                                                
                                    
x
+
TestKicExistingNetwork (24.38s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:102: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:94: (dbg) Run:  out/minikube-linux-amd64 start -p existing-network-20210915185239-498219 --network=existing-network
kic_custom_network_test.go:94: (dbg) Done: out/minikube-linux-amd64 start -p existing-network-20210915185239-498219 --network=existing-network: (21.610155786s)
helpers_test.go:176: Cleaning up "existing-network-20210915185239-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p existing-network-20210915185239-498219
helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p existing-network-20210915185239-498219: (2.515000177s)
--- PASS: TestKicExistingNetwork (24.38s)

                                                
                                    
x
+
TestMainNoArgs (0.05s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-amd64
--- PASS: TestMainNoArgs (0.05s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (97.77s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:82: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20210915185304-498219 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E0915 18:54:25.846806  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 18:54:33.724053  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
E0915 18:54:33.729377  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
E0915 18:54:33.739546  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
E0915 18:54:33.759822  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
E0915 18:54:33.800112  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
E0915 18:54:33.880458  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
E0915 18:54:34.040904  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
E0915 18:54:34.361504  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
E0915 18:54:35.002426  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
E0915 18:54:36.283336  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
multinode_test.go:82: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20210915185304-498219 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m37.17726067s)
multinode_test.go:88: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (97.77s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (5.62s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:463: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:468: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- rollout status deployment/busybox
E0915 18:54:42.516368  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
multinode_test.go:468: (dbg) Done: out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- rollout status deployment/busybox: (3.847787456s)
multinode_test.go:474: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:486: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:494: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- exec busybox-84b6686758-9468n -- nslookup kubernetes.io
multinode_test.go:494: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- exec busybox-84b6686758-k9vfn -- nslookup kubernetes.io
multinode_test.go:504: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- exec busybox-84b6686758-9468n -- nslookup kubernetes.default
multinode_test.go:504: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- exec busybox-84b6686758-k9vfn -- nslookup kubernetes.default
multinode_test.go:512: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- exec busybox-84b6686758-9468n -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:512: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- exec busybox-84b6686758-k9vfn -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (5.62s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.8s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:522: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:530: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- exec busybox-84b6686758-9468n -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
E0915 18:54:47.637000  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
multinode_test.go:538: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- exec busybox-84b6686758-9468n -- sh -c "ping -c 1 192.168.49.1"
multinode_test.go:530: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- exec busybox-84b6686758-k9vfn -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:538: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185304-498219 -- exec busybox-84b6686758-k9vfn -- sh -c "ping -c 1 192.168.49.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.80s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (43.84s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:107: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-20210915185304-498219 -v 3 --alsologtostderr
E0915 18:54:53.531436  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 18:54:57.877252  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
E0915 18:55:18.357878  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
multinode_test.go:107: (dbg) Done: out/minikube-linux-amd64 node add -p multinode-20210915185304-498219 -v 3 --alsologtostderr: (37.298574429s)
multinode_test.go:113: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 status --alsologtostderr
multinode_test.go:113: (dbg) Done: out/minikube-linux-amd64 -p multinode-20210915185304-498219 status --alsologtostderr: (6.541667273s)
--- PASS: TestMultiNode/serial/AddNode (43.84s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.37s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:129: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.37s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (2.83s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:170: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 status --output json --alsologtostderr
helpers_test.go:535: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:549: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 ssh "sudo cat /home/docker/cp-test.txt"
helpers_test.go:535: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 cp testdata/cp-test.txt multinode-20210915185304-498219-m02:/home/docker/cp-test.txt
helpers_test.go:549: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 ssh -n multinode-20210915185304-498219-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:535: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 cp testdata/cp-test.txt multinode-20210915185304-498219-m03:/home/docker/cp-test.txt
helpers_test.go:549: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 ssh -n multinode-20210915185304-498219-m03 "sudo cat /home/docker/cp-test.txt"
--- PASS: TestMultiNode/serial/CopyFile (2.83s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (21.98s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:192: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 node stop m03
multinode_test.go:192: (dbg) Done: out/minikube-linux-amd64 -p multinode-20210915185304-498219 node stop m03: (20.707919401s)
multinode_test.go:198: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 status
multinode_test.go:198: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20210915185304-498219 status: exit status 7 (630.696529ms)

                                                
                                                
-- stdout --
	multinode-20210915185304-498219
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-20210915185304-498219-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-20210915185304-498219-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:205: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 status --alsologtostderr
multinode_test.go:205: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20210915185304-498219 status --alsologtostderr: exit status 7 (637.754021ms)

                                                
                                                
-- stdout --
	multinode-20210915185304-498219
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-20210915185304-498219-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-20210915185304-498219-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0915 18:55:56.638826  563420 out.go:298] Setting OutFile to fd 1 ...
	I0915 18:55:56.639018  563420 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 18:55:56.639028  563420 out.go:311] Setting ErrFile to fd 2...
	I0915 18:55:56.639032  563420 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 18:55:56.639132  563420 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	I0915 18:55:56.639292  563420 out.go:305] Setting JSON to false
	I0915 18:55:56.639312  563420 mustload.go:65] Loading cluster: multinode-20210915185304-498219
	I0915 18:55:56.639613  563420 config.go:177] Loaded profile config "multinode-20210915185304-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 18:55:56.639632  563420 status.go:253] checking status of multinode-20210915185304-498219 ...
	I0915 18:55:56.639978  563420 cli_runner.go:115] Run: docker container inspect multinode-20210915185304-498219 --format={{.State.Status}}
	I0915 18:55:56.680876  563420 status.go:328] multinode-20210915185304-498219 host status = "Running" (err=<nil>)
	I0915 18:55:56.680916  563420 host.go:66] Checking if "multinode-20210915185304-498219" exists ...
	I0915 18:55:56.681162  563420 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-20210915185304-498219
	I0915 18:55:56.720462  563420 host.go:66] Checking if "multinode-20210915185304-498219" exists ...
	I0915 18:55:56.720747  563420 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0915 18:55:56.720782  563420 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-20210915185304-498219
	I0915 18:55:56.760210  563420 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33069 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/multinode-20210915185304-498219/id_rsa Username:docker}
	I0915 18:55:56.836311  563420 ssh_runner.go:152] Run: systemctl --version
	I0915 18:55:56.840154  563420 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
	I0915 18:55:56.848641  563420 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 18:55:56.930389  563420 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:45 SystemTime:2021-09-15 18:55:56.885388937 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 18:55:56.931233  563420 kubeconfig.go:93] found "multinode-20210915185304-498219" server: "https://192.168.49.2:8443"
	I0915 18:55:56.931260  563420 api_server.go:164] Checking apiserver status ...
	I0915 18:55:56.931299  563420 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0915 18:55:56.948554  563420 ssh_runner.go:152] Run: sudo egrep ^[0-9]+:freezer: /proc/1158/cgroup
	I0915 18:55:56.955688  563420 api_server.go:180] apiserver freezer: "10:freezer:/docker/e89e50f4b5c887326a157358ac42148f54beaf46eb5cd1bd66b235dc12038234/kubepods/burstable/pode1b60d25547a18ec7ef21368cf1dafd6/1ff83e862947d34993811332b0507792d4b6b7b24065ff82a2f5b1f0e4f7659d"
	I0915 18:55:56.955751  563420 ssh_runner.go:152] Run: sudo cat /sys/fs/cgroup/freezer/docker/e89e50f4b5c887326a157358ac42148f54beaf46eb5cd1bd66b235dc12038234/kubepods/burstable/pode1b60d25547a18ec7ef21368cf1dafd6/1ff83e862947d34993811332b0507792d4b6b7b24065ff82a2f5b1f0e4f7659d/freezer.state
	I0915 18:55:56.961792  563420 api_server.go:202] freezer state: "THAWED"
	I0915 18:55:56.961822  563420 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0915 18:55:56.966553  563420 api_server.go:265] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0915 18:55:56.966572  563420 status.go:419] multinode-20210915185304-498219 apiserver status = Running (err=<nil>)
	I0915 18:55:56.966582  563420 status.go:255] multinode-20210915185304-498219 status: &{Name:multinode-20210915185304-498219 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0915 18:55:56.966600  563420 status.go:253] checking status of multinode-20210915185304-498219-m02 ...
	I0915 18:55:56.966829  563420 cli_runner.go:115] Run: docker container inspect multinode-20210915185304-498219-m02 --format={{.State.Status}}
	I0915 18:55:57.005810  563420 status.go:328] multinode-20210915185304-498219-m02 host status = "Running" (err=<nil>)
	I0915 18:55:57.005837  563420 host.go:66] Checking if "multinode-20210915185304-498219-m02" exists ...
	I0915 18:55:57.006076  563420 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-20210915185304-498219-m02
	I0915 18:55:57.045627  563420 host.go:66] Checking if "multinode-20210915185304-498219-m02" exists ...
	I0915 18:55:57.045898  563420 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0915 18:55:57.045933  563420 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-20210915185304-498219-m02
	I0915 18:55:57.085499  563420 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33074 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/multinode-20210915185304-498219-m02/id_rsa Username:docker}
	I0915 18:55:57.175857  563420 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
	I0915 18:55:57.184657  563420 status.go:255] multinode-20210915185304-498219-m02 status: &{Name:multinode-20210915185304-498219-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0915 18:55:57.184704  563420 status.go:253] checking status of multinode-20210915185304-498219-m03 ...
	I0915 18:55:57.184958  563420 cli_runner.go:115] Run: docker container inspect multinode-20210915185304-498219-m03 --format={{.State.Status}}
	I0915 18:55:57.226075  563420 status.go:328] multinode-20210915185304-498219-m03 host status = "Stopped" (err=<nil>)
	I0915 18:55:57.226113  563420 status.go:341] host is not running, skipping remaining checks
	I0915 18:55:57.226121  563420 status.go:255] multinode-20210915185304-498219-m03 status: &{Name:multinode-20210915185304-498219-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (21.98s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (35.88s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:226: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:236: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 node start m03 --alsologtostderr
E0915 18:55:59.318764  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
multinode_test.go:236: (dbg) Done: out/minikube-linux-amd64 -p multinode-20210915185304-498219 node start m03 --alsologtostderr: (34.985031664s)
multinode_test.go:243: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 status
multinode_test.go:257: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (35.88s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (192.64s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:265: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-20210915185304-498219
multinode_test.go:272: (dbg) Run:  out/minikube-linux-amd64 stop -p multinode-20210915185304-498219
E0915 18:57:21.239819  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
multinode_test.go:272: (dbg) Done: out/minikube-linux-amd64 stop -p multinode-20210915185304-498219: (1m1.438072206s)
multinode_test.go:277: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20210915185304-498219 --wait=true -v=8 --alsologtostderr
E0915 18:59:25.847145  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 18:59:33.724349  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
multinode_test.go:277: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20210915185304-498219 --wait=true -v=8 --alsologtostderr: (2m11.089920195s)
multinode_test.go:282: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-20210915185304-498219
--- PASS: TestMultiNode/serial/RestartKeepsNodes (192.64s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (25.2s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:376: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 node delete m03
E0915 19:00:05.081364  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
multinode_test.go:376: (dbg) Done: out/minikube-linux-amd64 -p multinode-20210915185304-498219 node delete m03: (24.442673103s)
multinode_test.go:382: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 status --alsologtostderr
multinode_test.go:396: (dbg) Run:  docker volume ls
multinode_test.go:406: (dbg) Run:  kubectl get nodes
multinode_test.go:414: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (25.20s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (41.39s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:296: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 stop
multinode_test.go:296: (dbg) Done: out/minikube-linux-amd64 -p multinode-20210915185304-498219 stop: (41.130161549s)
multinode_test.go:302: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 status
multinode_test.go:302: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20210915185304-498219 status: exit status 7 (130.931167ms)

                                                
                                                
-- stdout --
	multinode-20210915185304-498219
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-20210915185304-498219-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:309: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 status --alsologtostderr
multinode_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20210915185304-498219 status --alsologtostderr: exit status 7 (127.153529ms)

                                                
                                                
-- stdout --
	multinode-20210915185304-498219
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-20210915185304-498219-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0915 19:00:52.261695  574500 out.go:298] Setting OutFile to fd 1 ...
	I0915 19:00:52.261888  574500 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:00:52.261897  574500 out.go:311] Setting ErrFile to fd 2...
	I0915 19:00:52.261901  574500 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:00:52.261980  574500 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	I0915 19:00:52.262124  574500 out.go:305] Setting JSON to false
	I0915 19:00:52.262143  574500 mustload.go:65] Loading cluster: multinode-20210915185304-498219
	I0915 19:00:52.262423  574500 config.go:177] Loaded profile config "multinode-20210915185304-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 19:00:52.262436  574500 status.go:253] checking status of multinode-20210915185304-498219 ...
	I0915 19:00:52.262760  574500 cli_runner.go:115] Run: docker container inspect multinode-20210915185304-498219 --format={{.State.Status}}
	I0915 19:00:52.300631  574500 status.go:328] multinode-20210915185304-498219 host status = "Stopped" (err=<nil>)
	I0915 19:00:52.300657  574500 status.go:341] host is not running, skipping remaining checks
	I0915 19:00:52.300663  574500 status.go:255] multinode-20210915185304-498219 status: &{Name:multinode-20210915185304-498219 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0915 19:00:52.300694  574500 status.go:253] checking status of multinode-20210915185304-498219-m02 ...
	I0915 19:00:52.300949  574500 cli_runner.go:115] Run: docker container inspect multinode-20210915185304-498219-m02 --format={{.State.Status}}
	I0915 19:00:52.339163  574500 status.go:328] multinode-20210915185304-498219-m02 host status = "Stopped" (err=<nil>)
	I0915 19:00:52.339189  574500 status.go:341] host is not running, skipping remaining checks
	I0915 19:00:52.339195  574500 status.go:255] multinode-20210915185304-498219-m02 status: &{Name:multinode-20210915185304-498219-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (41.39s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (93.04s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:326: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:336: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20210915185304-498219 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
multinode_test.go:336: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20210915185304-498219 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m32.266474902s)
multinode_test.go:342: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185304-498219 status --alsologtostderr
multinode_test.go:356: (dbg) Run:  kubectl get nodes
multinode_test.go:364: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (93.04s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (47.17s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:425: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-20210915185304-498219
multinode_test.go:434: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20210915185304-498219-m02 --driver=docker  --container-runtime=containerd
multinode_test.go:434: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p multinode-20210915185304-498219-m02 --driver=docker  --container-runtime=containerd: exit status 14 (98.973161ms)

                                                
                                                
-- stdout --
	* [multinode-20210915185304-498219-m02] minikube v1.23.0 on Debian 9.13 (kvm/amd64)
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube
	  - MINIKUBE_LOCATION=12425
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-20210915185304-498219-m02' is duplicated with machine name 'multinode-20210915185304-498219-m02' in profile 'multinode-20210915185304-498219'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:442: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20210915185304-498219-m03 --driver=docker  --container-runtime=containerd
multinode_test.go:442: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20210915185304-498219-m03 --driver=docker  --container-runtime=containerd: (43.883936399s)
multinode_test.go:449: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-20210915185304-498219
multinode_test.go:449: (dbg) Non-zero exit: out/minikube-linux-amd64 node add -p multinode-20210915185304-498219: exit status 80 (358.733764ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-20210915185304-498219
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: Node multinode-20210915185304-498219-m03 already exists in multinode-20210915185304-498219-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:454: (dbg) Run:  out/minikube-linux-amd64 delete -p multinode-20210915185304-498219-m03
multinode_test.go:454: (dbg) Done: out/minikube-linux-amd64 delete -p multinode-20210915185304-498219-m03: (2.779776735s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (47.17s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_debian_sid/minikube (0s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_debian_sid/minikube
--- PASS: TestDebPackageInstall/install_amd64_debian_sid/minikube (0.00s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_debian_sid/kvm2-driver (11.73s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_debian_sid/kvm2-driver
pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp debian:sid sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"
pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp debian:sid sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (11.730372292s)
--- PASS: TestDebPackageInstall/install_amd64_debian_sid/kvm2-driver (11.73s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_debian_latest/minikube (0s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_debian_latest/minikube
--- PASS: TestDebPackageInstall/install_amd64_debian_latest/minikube (0.00s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_debian_latest/kvm2-driver (10.14s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_debian_latest/kvm2-driver
pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp debian:latest sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"
pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp debian:latest sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (10.141655937s)
--- PASS: TestDebPackageInstall/install_amd64_debian_latest/kvm2-driver (10.14s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_debian_10/minikube (0s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_debian_10/minikube
--- PASS: TestDebPackageInstall/install_amd64_debian_10/minikube (0.00s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_debian_10/kvm2-driver (10s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_debian_10/kvm2-driver
pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp debian:10 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"
pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp debian:10 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (10.000861814s)
--- PASS: TestDebPackageInstall/install_amd64_debian_10/kvm2-driver (10.00s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_debian_9/minikube (0s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_debian_9/minikube
--- PASS: TestDebPackageInstall/install_amd64_debian_9/minikube (0.00s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_debian_9/kvm2-driver (8.21s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_debian_9/kvm2-driver
pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp debian:9 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"
pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp debian:9 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (8.210681496s)
--- PASS: TestDebPackageInstall/install_amd64_debian_9/kvm2-driver (8.21s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_ubuntu_latest/minikube (0s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_ubuntu_latest/minikube
--- PASS: TestDebPackageInstall/install_amd64_ubuntu_latest/minikube (0.00s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_ubuntu_latest/kvm2-driver (147.3s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_ubuntu_latest/kvm2-driver
pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp ubuntu:latest sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"
E0915 19:04:25.847128  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 19:04:33.725239  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
E0915 19:05:48.893292  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp ubuntu:latest sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (2m27.300557219s)
--- PASS: TestDebPackageInstall/install_amd64_ubuntu_latest/kvm2-driver (147.30s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_ubuntu_20.10/minikube (0s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_ubuntu_20.10/minikube
--- PASS: TestDebPackageInstall/install_amd64_ubuntu_20.10/minikube (0.00s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_ubuntu_20.10/kvm2-driver (190.55s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_ubuntu_20.10/kvm2-driver
pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp ubuntu:20.10 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"
E0915 19:09:25.846723  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 19:09:33.723831  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp ubuntu:20.10 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (3m10.550567607s)
--- PASS: TestDebPackageInstall/install_amd64_ubuntu_20.10/kvm2-driver (190.55s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_ubuntu_20.04/minikube (0s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_ubuntu_20.04/minikube
--- PASS: TestDebPackageInstall/install_amd64_ubuntu_20.04/minikube (0.00s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_ubuntu_20.04/kvm2-driver (138.81s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_ubuntu_20.04/kvm2-driver
pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp ubuntu:20.04 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"
E0915 19:11:00.441627  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_containerd_integration/out:/var/tmp ubuntu:20.04 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (2m18.813128534s)
--- PASS: TestDebPackageInstall/install_amd64_ubuntu_20.04/kvm2-driver (138.81s)

                                                
                                    
x
+
TestDebPackageInstall/install_amd64_ubuntu_18.04/minikube (0s)

                                                
                                                
=== RUN   TestDebPackageInstall/install_amd64_ubuntu_18.04/minikube
--- PASS: TestDebPackageInstall/install_amd64_ubuntu_18.04/minikube (0.00s)

                                                
                                    
x
+
TestPreload (134.99s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:49: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-20210915191317-498219 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.17.0
E0915 19:14:25.847090  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 19:14:33.723893  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
preload_test.go:49: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-20210915191317-498219 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.17.0: (1m25.930954102s)
preload_test.go:62: (dbg) Run:  out/minikube-linux-amd64 ssh -p test-preload-20210915191317-498219 -- sudo crictl pull busybox
preload_test.go:62: (dbg) Done: out/minikube-linux-amd64 ssh -p test-preload-20210915191317-498219 -- sudo crictl pull busybox: (2.922716959s)
preload_test.go:72: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-20210915191317-498219 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd --kubernetes-version=v1.17.3
preload_test.go:72: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-20210915191317-498219 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd --kubernetes-version=v1.17.3: (42.745603554s)
preload_test.go:81: (dbg) Run:  out/minikube-linux-amd64 ssh -p test-preload-20210915191317-498219 -- sudo crictl image ls
helpers_test.go:176: Cleaning up "test-preload-20210915191317-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p test-preload-20210915191317-498219
helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p test-preload-20210915191317-498219: (3.02466812s)
--- PASS: TestPreload (134.99s)

                                                
                                    
x
+
TestInsufficientStorage (13.56s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:51: (dbg) Run:  out/minikube-linux-amd64 start -p insufficient-storage-20210915191703-498219 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd
status_test.go:51: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p insufficient-storage-20210915191703-498219 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd: exit status 26 (6.542043139s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"7512acd3-f8db-4c5c-b637-808a00ce7048","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-20210915191703-498219] minikube v1.23.0 on Debian 9.13 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"a4198391-52b5-4558-b3fc-b7b9793f2472","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig"}}
	{"specversion":"1.0","id":"a18c2eec-2a79-475e-aa20-19e30c9e39b4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
	{"specversion":"1.0","id":"449a025f-f065-4c41-af07-f2cdc35690c8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube"}}
	{"specversion":"1.0","id":"99e8fc84-bb05-45ed-ac65-ac4433f9c7fe","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=12425"}}
	{"specversion":"1.0","id":"cb781cdd-9ddb-4bb9-b099-b82cda3ef860","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"fa403f92-ca1b-40e6-a90c-a11c65713bd0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"227c534a-3540-4182-a64a-d28cc821b873","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"Your cgroup does not allow setting memory."}}
	{"specversion":"1.0","id":"42e3622f-9b02-49a0-9d7e-4963ed3ee99b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities"}}
	{"specversion":"1.0","id":"62ea6d85-0d3b-4762-a0d3-ca8af92a88d8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-20210915191703-498219 in cluster insufficient-storage-20210915191703-498219","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"ae0f155b-0811-4ea1-866c-36ff1b31143c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"51f4fa6a-a255-4b85-9dac-e01ea78ccf18","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"72b6a085-7578-45f2-9933-d53dc3dc76ea","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity)","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:77: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-20210915191703-498219 --output=json --layout=cluster
status_test.go:77: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-20210915191703-498219 --output=json --layout=cluster: exit status 7 (353.839232ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-20210915191703-498219","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.23.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-20210915191703-498219","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0915 19:17:10.722954  618989 status.go:413] kubeconfig endpoint: extract IP: "insufficient-storage-20210915191703-498219" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

                                                
                                                
** /stderr **
status_test.go:77: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-20210915191703-498219 --output=json --layout=cluster
status_test.go:77: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-20210915191703-498219 --output=json --layout=cluster: exit status 7 (346.11584ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-20210915191703-498219","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.23.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-20210915191703-498219","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0915 19:17:11.069549  619091 status.go:413] kubeconfig endpoint: extract IP: "insufficient-storage-20210915191703-498219" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	E0915 19:17:11.081570  619091 status.go:557] unable to read event log: stat: stat /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/insufficient-storage-20210915191703-498219/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:176: Cleaning up "insufficient-storage-20210915191703-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p insufficient-storage-20210915191703-498219
helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p insufficient-storage-20210915191703-498219: (6.318927036s)
--- PASS: TestInsufficientStorage (13.56s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (152.03s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:128: (dbg) Run:  /tmp/minikube-v1.16.0.3338702001.exe start -p running-upgrade-20210915192201-498219 --memory=2200 --vm-driver=docker  --container-runtime=containerd
E0915 19:22:28.895889  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:128: (dbg) Done: /tmp/minikube-v1.16.0.3338702001.exe start -p running-upgrade-20210915192201-498219 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (1m3.249026619s)
version_upgrade_test.go:138: (dbg) Run:  out/minikube-linux-amd64 start -p running-upgrade-20210915192201-498219 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:138: (dbg) Done: out/minikube-linux-amd64 start -p running-upgrade-20210915192201-498219 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m25.486196524s)
helpers_test.go:176: Cleaning up "running-upgrade-20210915192201-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p running-upgrade-20210915192201-498219
helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p running-upgrade-20210915192201-498219: (2.785482004s)
--- PASS: TestRunningBinaryUpgrade (152.03s)

                                                
                                    
x
+
TestKubernetesUpgrade (215.87s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:226: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191929-498219 --memory=2200 --kubernetes-version=v1.14.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E0915 19:19:33.724165  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
version_upgrade_test.go:226: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191929-498219 --memory=2200 --kubernetes-version=v1.14.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (45.170812987s)
version_upgrade_test.go:231: (dbg) Run:  out/minikube-linux-amd64 stop -p kubernetes-upgrade-20210915191929-498219
version_upgrade_test.go:231: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-20210915191929-498219: (20.741494455s)
version_upgrade_test.go:236: (dbg) Run:  out/minikube-linux-amd64 -p kubernetes-upgrade-20210915191929-498219 status --format={{.Host}}
version_upgrade_test.go:236: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-20210915191929-498219 status --format={{.Host}}: exit status 7 (92.107439ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:238: status error: exit status 7 (may be ok)
version_upgrade_test.go:247: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191929-498219 --memory=2200 --kubernetes-version=v1.22.2-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:247: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191929-498219 --memory=2200 --kubernetes-version=v1.22.2-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m13.149391646s)
version_upgrade_test.go:252: (dbg) Run:  kubectl --context kubernetes-upgrade-20210915191929-498219 version --output=json
version_upgrade_test.go:271: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:273: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191929-498219 --memory=2200 --kubernetes-version=v1.14.0 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:273: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191929-498219 --memory=2200 --kubernetes-version=v1.14.0 --driver=docker  --container-runtime=containerd: exit status 106 (133.592378ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-20210915191929-498219] minikube v1.23.0 on Debian 9.13 (kvm/amd64)
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube
	  - MINIKUBE_LOCATION=12425
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.22.2-rc.0 cluster to v1.14.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.14.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-20210915191929-498219
	    minikube start -p kubernetes-upgrade-20210915191929-498219 --kubernetes-version=v1.14.0
	    
	    2) Create a second cluster with Kubernetes 1.14.0, by running:
	    
	    minikube start -p kubernetes-upgrade-20210915191929-4982192 --kubernetes-version=v1.14.0
	    
	    3) Use the existing cluster at version Kubernetes 1.22.2-rc.0, by running:
	    
	    minikube start -p kubernetes-upgrade-20210915191929-498219 --kubernetes-version=v1.22.2-rc.0
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:277: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:279: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191929-498219 --memory=2200 --kubernetes-version=v1.22.2-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:279: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191929-498219 --memory=2200 --kubernetes-version=v1.22.2-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m4.202543989s)
helpers_test.go:176: Cleaning up "kubernetes-upgrade-20210915191929-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p kubernetes-upgrade-20210915191929-498219

                                                
                                                
=== CONT  TestKubernetesUpgrade
helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p kubernetes-upgrade-20210915191929-498219: (12.297876514s)
--- PASS: TestKubernetesUpgrade (215.87s)

                                                
                                    
x
+
TestMissingContainerUpgrade (130.36s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:313: (dbg) Run:  /tmp/minikube-v1.9.1.2412804675.exe start -p missing-upgrade-20210915191719-498219 --memory=2200 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:313: (dbg) Done: /tmp/minikube-v1.9.1.2412804675.exe start -p missing-upgrade-20210915191719-498219 --memory=2200 --driver=docker  --container-runtime=containerd: (1m10.882296953s)
version_upgrade_test.go:322: (dbg) Run:  docker stop missing-upgrade-20210915191719-498219
version_upgrade_test.go:322: (dbg) Done: docker stop missing-upgrade-20210915191719-498219: (12.376089744s)
version_upgrade_test.go:327: (dbg) Run:  docker rm missing-upgrade-20210915191719-498219
version_upgrade_test.go:333: (dbg) Run:  out/minikube-linux-amd64 start -p missing-upgrade-20210915191719-498219 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E0915 19:19:25.846753  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
version_upgrade_test.go:333: (dbg) Done: out/minikube-linux-amd64 start -p missing-upgrade-20210915191719-498219 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (43.634272866s)
helpers_test.go:176: Cleaning up "missing-upgrade-20210915191719-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p missing-upgrade-20210915191719-498219
helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p missing-upgrade-20210915191719-498219: (2.88506908s)
--- PASS: TestMissingContainerUpgrade (130.36s)

                                                
                                    
x
+
TestPause/serial/Start (319.54s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:78: (dbg) Run:  out/minikube-linux-amd64 start -p pause-20210915191717-498219 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestPause/serial/Start
pause_test.go:78: (dbg) Done: out/minikube-linux-amd64 start -p pause-20210915191717-498219 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd: (5m19.53620335s)
--- PASS: TestPause/serial/Start (319.54s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (1.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:214: (dbg) Run:  out/minikube-linux-amd64 start -p false-20210915191718-498219 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd
net_test.go:214: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p false-20210915191718-498219 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd: exit status 14 (296.007664ms)

                                                
                                                
-- stdout --
	* [false-20210915191718-498219] minikube v1.23.0 on Debian 9.13 (kvm/amd64)
	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube
	  - MINIKUBE_LOCATION=12425
	* Using the docker driver based on user configuration
	  - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0915 19:17:18.104160  620124 out.go:298] Setting OutFile to fd 1 ...
	I0915 19:17:18.104268  620124 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:17:18.104279  620124 out.go:311] Setting ErrFile to fd 2...
	I0915 19:17:18.104284  620124 out.go:345] TERM=,COLORTERM=, which probably does not support color
	I0915 19:17:18.104436  620124 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin
	I0915 19:17:18.104808  620124 out.go:305] Setting JSON to false
	I0915 19:17:18.148927  620124 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-1","uptime":17996,"bootTime":1631715442,"procs":187,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}
	I0915 19:17:18.149052  620124 start.go:121] virtualization: kvm guest
	I0915 19:17:18.152014  620124 out.go:177] * [false-20210915191718-498219] minikube v1.23.0 on Debian 9.13 (kvm/amd64)
	I0915 19:17:18.154279  620124 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig
	I0915 19:17:18.152190  620124 notify.go:169] Checking for updates...
	I0915 19:17:18.157734  620124 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0915 19:17:18.159408  620124 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube
	I0915 19:17:18.160928  620124 out.go:177]   - MINIKUBE_LOCATION=12425
	I0915 19:17:18.161513  620124 config.go:177] Loaded profile config "force-systemd-env-20210915191717-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 19:17:18.161651  620124 config.go:177] Loaded profile config "offline-containerd-20210915191717-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 19:17:18.161759  620124 config.go:177] Loaded profile config "pause-20210915191717-498219": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.1
	I0915 19:17:18.161829  620124 driver.go:343] Setting default libvirt URI to qemu:///system
	I0915 19:17:18.220676  620124 docker.go:132] docker version: linux-19.03.15
	I0915 19:17:18.220830  620124 cli_runner.go:115] Run: docker system info --format "{{json .}}"
	I0915 19:17:18.328615  620124 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:180 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:22 OomKillDisable:true NGoroutines:35 SystemTime:2021-09-15 19:17:18.267917727 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr
ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-1 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin
gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}
	I0915 19:17:18.328717  620124 docker.go:237] overlay module found
	I0915 19:17:18.331090  620124 out.go:177] * Using the docker driver based on user configuration
	I0915 19:17:18.331117  620124 start.go:278] selected driver: docker
	I0915 19:17:18.331123  620124 start.go:751] validating driver "docker" against <nil>
	I0915 19:17:18.331144  620124 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
	W0915 19:17:18.331187  620124 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.
	W0915 19:17:18.331208  620124 out.go:242] ! Your cgroup does not allow setting memory.
	! Your cgroup does not allow setting memory.
	I0915 19:17:18.332868  620124 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities
	I0915 19:17:18.334997  620124 out.go:177] 
	W0915 19:17:18.335119  620124 out.go:242] X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	I0915 19:17:18.336784  620124 out.go:177] 

                                                
                                                
** /stderr **
helpers_test.go:176: Cleaning up "false-20210915191718-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p false-20210915191718-498219
--- PASS: TestNetworkPlugins/group/false (1.12s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (347.26s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:187: (dbg) Run:  /tmp/minikube-v1.16.0.427020317.exe start -p stopped-upgrade-20210915192150-498219 --memory=2200 --vm-driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:187: (dbg) Done: /tmp/minikube-v1.16.0.427020317.exe start -p stopped-upgrade-20210915192150-498219 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (4m29.780916966s)
version_upgrade_test.go:196: (dbg) Run:  /tmp/minikube-v1.16.0.427020317.exe -p stopped-upgrade-20210915192150-498219 stop
version_upgrade_test.go:196: (dbg) Done: /tmp/minikube-v1.16.0.427020317.exe -p stopped-upgrade-20210915192150-498219 stop: (12.076865543s)
version_upgrade_test.go:202: (dbg) Run:  out/minikube-linux-amd64 start -p stopped-upgrade-20210915192150-498219 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:202: (dbg) Done: out/minikube-linux-amd64 start -p stopped-upgrade-20210915192150-498219 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m5.401929678s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (347.26s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (16.1s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:90: (dbg) Run:  out/minikube-linux-amd64 start -p pause-20210915191717-498219 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
pause_test.go:90: (dbg) Done: out/minikube-linux-amd64 start -p pause-20210915191717-498219 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (16.086218944s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (16.10s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.7s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:119: (dbg) Run:  out/minikube-linux-amd64 unpause -p pause-20210915191717-498219 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.70s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (3.08s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:130: (dbg) Run:  out/minikube-linux-amd64 delete -p pause-20210915191717-498219 --alsologtostderr -v=5
pause_test.go:130: (dbg) Done: out/minikube-linux-amd64 delete -p pause-20210915191717-498219 --alsologtostderr -v=5: (3.077298255s)
--- PASS: TestPause/serial/DeletePaused (3.08s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.69s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:140: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
pause_test.go:166: (dbg) Run:  docker ps -a
pause_test.go:171: (dbg) Run:  docker volume inspect pause-20210915191717-498219
pause_test.go:171: (dbg) Non-zero exit: docker volume inspect pause-20210915191717-498219: exit status 1 (41.585951ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error: No such volume: pause-20210915191717-498219

                                                
                                                
** /stderr **
--- PASS: TestPause/serial/VerifyDeletedResources (0.69s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (75.77s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p auto-20210915191717-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestNetworkPlugins/group/auto/Start
net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p auto-20210915191717-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --driver=docker  --container-runtime=containerd: (1m15.772252406s)
--- PASS: TestNetworkPlugins/group/auto/Start (75.77s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-weave/Start (79.77s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-weave/Start
net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p custom-weave-20210915191719-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=testdata/weavenet.yaml --driver=docker  --container-runtime=containerd
E0915 19:24:25.846978  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory

                                                
                                                
=== CONT  TestNetworkPlugins/group/custom-weave/Start
net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p custom-weave-20210915191719-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=testdata/weavenet.yaml --driver=docker  --container-runtime=containerd: (1m19.770237879s)
--- PASS: TestNetworkPlugins/group/custom-weave/Start (79.77s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/Start (90.45s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/Start
net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p cilium-20210915191719-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker  --container-runtime=containerd
E0915 19:24:33.724037  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory

                                                
                                                
=== CONT  TestNetworkPlugins/group/cilium/Start
net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p cilium-20210915191719-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker  --container-runtime=containerd: (1m30.453897997s)
--- PASS: TestNetworkPlugins/group/cilium/Start (90.45s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.37s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p auto-20210915191717-498219 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (8.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:132: (dbg) Run:  kubectl --context auto-20210915191717-498219 replace --force -f testdata/netcat-deployment.yaml
net_test.go:146: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:343: "netcat-66fbc655d5-mvgwv" [87390341-079e-4543-bcd0-c830a1268b9c] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:343: "netcat-66fbc655d5-mvgwv" [87390341-079e-4543-bcd0-c830a1268b9c] Running

                                                
                                                
=== CONT  TestNetworkPlugins/group/auto/NetCatPod
net_test.go:146: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 8.006086463s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (8.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-weave/KubeletFlags (0.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-weave/KubeletFlags
net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p custom-weave-20210915191719-498219 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-weave/KubeletFlags (0.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-weave/NetCatPod (8.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-weave/NetCatPod
net_test.go:132: (dbg) Run:  kubectl --context custom-weave-20210915191719-498219 replace --force -f testdata/netcat-deployment.yaml
net_test.go:146: (dbg) TestNetworkPlugins/group/custom-weave/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:343: "netcat-66fbc655d5-p8gwv" [a2155292-1950-4e08-919f-37169690dccd] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

                                                
                                                
=== CONT  TestNetworkPlugins/group/custom-weave/NetCatPod
helpers_test.go:343: "netcat-66fbc655d5-p8gwv" [a2155292-1950-4e08-919f-37169690dccd] Running

                                                
                                                
=== CONT  TestNetworkPlugins/group/custom-weave/NetCatPod
net_test.go:146: (dbg) TestNetworkPlugins/group/custom-weave/NetCatPod: app=netcat healthy within 8.006902418s
--- PASS: TestNetworkPlugins/group/custom-weave/NetCatPod (8.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:163: (dbg) Run:  kubectl --context auto-20210915191717-498219 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:182: (dbg) Run:  kubectl --context auto-20210915191717-498219 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:232: (dbg) Run:  kubectl --context auto-20210915191717-498219 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (82.72s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p calico-20210915191719-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestNetworkPlugins/group/calico/Start
net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p calico-20210915191719-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker  --container-runtime=containerd: (1m22.721911693s)
--- PASS: TestNetworkPlugins/group/calico/Start (82.72s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (60.68s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p enable-default-cni-20210915191717-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --enable-default-cni=true --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p enable-default-cni-20210915191717-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --enable-default-cni=true --driver=docker  --container-runtime=containerd: (1m0.678153926s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (60.68s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/ControllerPod (5.02s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/ControllerPod
net_test.go:107: (dbg) TestNetworkPlugins/group/cilium/ControllerPod: waiting 10m0s for pods matching "k8s-app=cilium" in namespace "kube-system" ...
helpers_test.go:343: "cilium-p5m2q" [23c6c18b-f0f4-4c9c-b226-a7058dbf5f73] Running
net_test.go:107: (dbg) TestNetworkPlugins/group/cilium/ControllerPod: k8s-app=cilium healthy within 5.015321448s
--- PASS: TestNetworkPlugins/group/cilium/ControllerPod (5.02s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/KubeletFlags (0.39s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/KubeletFlags
net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p cilium-20210915191719-498219 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/cilium/KubeletFlags (0.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/NetCatPod (9.5s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/NetCatPod
net_test.go:132: (dbg) Run:  kubectl --context cilium-20210915191719-498219 replace --force -f testdata/netcat-deployment.yaml
net_test.go:146: (dbg) TestNetworkPlugins/group/cilium/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:343: "netcat-66fbc655d5-95x45" [7d9df266-0a7e-423b-9c7b-52f9b778de97] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:343: "netcat-66fbc655d5-95x45" [7d9df266-0a7e-423b-9c7b-52f9b778de97] Running
net_test.go:146: (dbg) TestNetworkPlugins/group/cilium/NetCatPod: app=netcat healthy within 9.046858635s
--- PASS: TestNetworkPlugins/group/cilium/NetCatPod (9.50s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/DNS (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/DNS
net_test.go:163: (dbg) Run:  kubectl --context cilium-20210915191719-498219 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/cilium/DNS (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/Localhost (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/Localhost
net_test.go:182: (dbg) Run:  kubectl --context cilium-20210915191719-498219 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/cilium/Localhost (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium/HairPin (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium/HairPin
net_test.go:232: (dbg) Run:  kubectl --context cilium-20210915191719-498219 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/cilium/HairPin (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (71.77s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p kindnet-20210915191718-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=kindnet --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestNetworkPlugins/group/kindnet/Start
net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p kindnet-20210915191718-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=kindnet --driver=docker  --container-runtime=containerd: (1m11.774023705s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (71.77s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.45s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p enable-default-cni-20210915191717-498219 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.45s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:132: (dbg) Run:  kubectl --context enable-default-cni-20210915191717-498219 replace --force -f testdata/netcat-deployment.yaml
net_test.go:146: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:343: "netcat-66fbc655d5-chm5g" [14ec6bd5-d3f1-4464-aeb4-78a288ce6da2] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:343: "netcat-66fbc655d5-chm5g" [14ec6bd5-d3f1-4464-aeb4-78a288ce6da2] Running
net_test.go:146: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 9.015749711s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:163: (dbg) Run:  kubectl --context enable-default-cni-20210915191717-498219 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:182: (dbg) Run:  kubectl --context enable-default-cni-20210915191717-498219 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:232: (dbg) Run:  kubectl --context enable-default-cni-20210915191717-498219 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (82.05s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p bridge-20210915191717-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=bridge --driver=docker  --container-runtime=containerd

                                                
                                                
=== CONT  TestNetworkPlugins/group/bridge/Start
net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p bridge-20210915191717-498219 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=bridge --driver=docker  --container-runtime=containerd: (1m22.046226202s)
--- PASS: TestNetworkPlugins/group/bridge/Start (82.05s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (8.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:107: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:343: "calico-node-9wzjf" [35a5585a-a49a-48fe-9a37-d71c6a34daa6] Running
net_test.go:107: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 8.350561962s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (8.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.67s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p calico-20210915191719-498219 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.67s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (10.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:132: (dbg) Run:  kubectl --context calico-20210915191719-498219 replace --force -f testdata/netcat-deployment.yaml
net_test.go:146: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:343: "netcat-66fbc655d5-tcgn6" [a1cbcecd-29b5-4ef0-ba35-6cc48198c344] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:343: "netcat-66fbc655d5-tcgn6" [a1cbcecd-29b5-4ef0-ba35-6cc48198c344] Running
net_test.go:146: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 10.009924714s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (10.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:163: (dbg) Run:  kubectl --context calico-20210915191719-498219 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:182: (dbg) Run:  kubectl --context calico-20210915191719-498219 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:232: (dbg) Run:  kubectl --context calico-20210915191719-498219 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.14s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (141.77s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-20210915192720-498219 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.14.0

                                                
                                                
=== CONT  TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-20210915192720-498219 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.14.0: (2m21.768232699s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (141.77s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (0.92s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:210: (dbg) Run:  out/minikube-linux-amd64 logs -p stopped-upgrade-20210915192150-498219
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (0.92s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (86.05s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-20210915192741-498219 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.2-rc.0

                                                
                                                
=== CONT  TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-20210915192741-498219 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.2-rc.0: (1m26.045355205s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (86.05s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (5.02s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:107: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:343: "kindnet-tfffd" [d9935504-af0c-46c7-95bb-c0be04b8cd85] Running
net_test.go:107: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 5.019307846s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (5.02s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.89s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p kindnet-20210915191718-498219 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.89s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (9.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:132: (dbg) Run:  kubectl --context kindnet-20210915191718-498219 replace --force -f testdata/netcat-deployment.yaml
net_test.go:146: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:343: "netcat-66fbc655d5-cfpcp" [289635de-addb-4e5b-9e8a-38a23a908cc3] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:343: "netcat-66fbc655d5-cfpcp" [289635de-addb-4e5b-9e8a-38a23a908cc3] Running
net_test.go:146: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 8.709631102s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (9.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:163: (dbg) Run:  kubectl --context kindnet-20210915191718-498219 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:182: (dbg) Run:  kubectl --context kindnet-20210915191718-498219 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:232: (dbg) Run:  kubectl --context kindnet-20210915191718-498219 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.18s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (69.72s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-20210915192805-498219 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.1

                                                
                                                
=== CONT  TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-20210915192805-498219 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.1: (1m9.719964892s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (69.72s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.37s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p bridge-20210915191717-498219 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (16.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:132: (dbg) Run:  kubectl --context bridge-20210915191717-498219 replace --force -f testdata/netcat-deployment.yaml
net_test.go:146: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:343: "netcat-66fbc655d5-tldsc" [925cf616-fcd0-4aa8-8764-df84e3229a6e] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:343: "netcat-66fbc655d5-tldsc" [925cf616-fcd0-4aa8-8764-df84e3229a6e] Running
net_test.go:146: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 16.006140653s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (16.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:163: (dbg) Run:  kubectl --context bridge-20210915191717-498219 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:182: (dbg) Run:  kubectl --context bridge-20210915191717-498219 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:232: (dbg) Run:  kubectl --context bridge-20210915191717-498219 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.15s)
E0915 19:35:49.754947  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:35:57.194206  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:36:02.936057  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:36:04.122495  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/FirstStart (72.51s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/FirstStart
start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-different-port-20210915192839-498219 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.1

                                                
                                                
=== CONT  TestStartStop/group/default-k8s-different-port/serial/FirstStart
start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-different-port-20210915192839-498219 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.1: (1m12.514850372s)
--- PASS: TestStartStop/group/default-k8s-different-port/serial/FirstStart (72.51s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (11.27s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:181: (dbg) Run:  kubectl --context no-preload-20210915192741-498219 create -f testdata/busybox.yaml
start_stop_delete_test.go:181: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:343: "busybox" [41c542ae-e984-40cc-83bf-4e1062ad70fe] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:343: "busybox" [41c542ae-e984-40cc-83bf-4e1062ad70fe] Running

                                                
                                                
=== CONT  TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:181: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 9.702887032s
start_stop_delete_test.go:181: (dbg) Run:  kubectl --context no-preload-20210915192741-498219 exec busybox -- /bin/sh -c "ulimit -n"
start_stop_delete_test.go:181: (dbg) Done: kubectl --context no-preload-20210915192741-498219 exec busybox -- /bin/sh -c "ulimit -n": (1.366538798s)
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (11.27s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (16.32s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:181: (dbg) Run:  kubectl --context embed-certs-20210915192805-498219 create -f testdata/busybox.yaml
start_stop_delete_test.go:181: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:343: "busybox" [1203c4a3-a5b2-4569-87e1-a5541390b532] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

                                                
                                                
=== CONT  TestStartStop/group/embed-certs/serial/DeployApp
helpers_test.go:343: "busybox" [1203c4a3-a5b2-4569-87e1-a5541390b532] Running
E0915 19:29:25.846387  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
start_stop_delete_test.go:181: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 16.016268044s
start_stop_delete_test.go:181: (dbg) Run:  kubectl --context embed-certs-20210915192805-498219 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (16.32s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (3.95s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p no-preload-20210915192741-498219 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:190: (dbg) Done: out/minikube-linux-amd64 addons enable metrics-server -p no-preload-20210915192741-498219 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (3.858793283s)
start_stop_delete_test.go:200: (dbg) Run:  kubectl --context no-preload-20210915192741-498219 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (3.95s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (20.77s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p no-preload-20210915192741-498219 --alsologtostderr -v=3

                                                
                                                
=== CONT  TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p no-preload-20210915192741-498219 --alsologtostderr -v=3: (20.774358116s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (20.77s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.76s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-20210915192805-498219 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:200: (dbg) Run:  kubectl --context embed-certs-20210915192805-498219 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.76s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (20.82s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p embed-certs-20210915192805-498219 --alsologtostderr -v=3
E0915 19:29:33.723785  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p embed-certs-20210915192805-498219 --alsologtostderr -v=3: (20.818950512s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (20.82s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (9.37s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:181: (dbg) Run:  kubectl --context old-k8s-version-20210915192720-498219 create -f testdata/busybox.yaml
start_stop_delete_test.go:181: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:343: "busybox" [4661c74a-165b-11ec-9a7d-024227afb4c1] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

                                                
                                                
=== CONT  TestStartStop/group/old-k8s-version/serial/DeployApp
helpers_test.go:343: "busybox" [4661c74a-165b-11ec-9a7d-024227afb4c1] Running
start_stop_delete_test.go:181: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 9.01280323s
start_stop_delete_test.go:181: (dbg) Run:  kubectl --context old-k8s-version-20210915192720-498219 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.37s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20210915192741-498219 -n no-preload-20210915192741-498219
start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20210915192741-498219 -n no-preload-20210915192741-498219: exit status 7 (94.811588ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:224: status error: exit status 7 (may be ok)
start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p no-preload-20210915192741-498219 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (327.5s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-20210915192741-498219 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.2-rc.0

                                                
                                                
=== CONT  TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-20210915192741-498219 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.2-rc.0: (5m26.883444089s)
start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20210915192741-498219 -n no-preload-20210915192741-498219
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (327.50s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.66s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p old-k8s-version-20210915192720-498219 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:200: (dbg) Run:  kubectl --context old-k8s-version-20210915192720-498219 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.66s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (20.81s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p old-k8s-version-20210915192720-498219 --alsologtostderr -v=3

                                                
                                                
=== CONT  TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p old-k8s-version-20210915192720-498219 --alsologtostderr -v=3: (20.810365146s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (20.81s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/DeployApp (10.62s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/DeployApp
start_stop_delete_test.go:181: (dbg) Run:  kubectl --context default-k8s-different-port-20210915192839-498219 create -f testdata/busybox.yaml
start_stop_delete_test.go:181: (dbg) TestStartStop/group/default-k8s-different-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:343: "busybox" [d9004f57-83ea-4943-89f2-42d2da60e114] Pending

                                                
                                                
=== CONT  TestStartStop/group/default-k8s-different-port/serial/DeployApp
helpers_test.go:343: "busybox" [d9004f57-83ea-4943-89f2-42d2da60e114] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:343: "busybox" [d9004f57-83ea-4943-89f2-42d2da60e114] Running
start_stop_delete_test.go:181: (dbg) TestStartStop/group/default-k8s-different-port/serial/DeployApp: integration-test=busybox healthy within 10.022920408s
start_stop_delete_test.go:181: (dbg) Run:  kubectl --context default-k8s-different-port-20210915192839-498219 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-different-port/serial/DeployApp (10.62s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20210915192805-498219 -n embed-certs-20210915192805-498219
start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20210915192805-498219 -n embed-certs-20210915192805-498219: exit status 7 (93.401739ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:224: status error: exit status 7 (may be ok)
start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p embed-certs-20210915192805-498219 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.19s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (325.96s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-20210915192805-498219 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.1

                                                
                                                
=== CONT  TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-20210915192805-498219 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.1: (5m25.490925574s)
start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20210915192805-498219 -n embed-certs-20210915192805-498219
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (325.96s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive (0.64s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-different-port-20210915192839-498219 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:200: (dbg) Run:  kubectl --context default-k8s-different-port-20210915192839-498219 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive (0.64s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/Stop (20.67s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/Stop
start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p default-k8s-different-port-20210915192839-498219 --alsologtostderr -v=3

                                                
                                                
=== CONT  TestStartStop/group/default-k8s-different-port/serial/Stop
start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p default-k8s-different-port-20210915192839-498219 --alsologtostderr -v=3: (20.673406095s)
--- PASS: TestStartStop/group/default-k8s-different-port/serial/Stop (20.67s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20210915192720-498219 -n old-k8s-version-20210915192720-498219
start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20210915192720-498219 -n old-k8s-version-20210915192720-498219: exit status 7 (109.996583ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:224: status error: exit status 7 (may be ok)
start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p old-k8s-version-20210915192720-498219 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.22s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (434.29s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-20210915192720-498219 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.14.0
E0915 19:30:22.070896  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:30:22.076157  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:30:22.086389  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:30:22.106612  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:30:22.146886  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:30:22.227383  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:30:22.388038  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:30:22.708627  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:30:23.349511  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-20210915192720-498219 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.14.0: (7m13.902327587s)
start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20210915192720-498219 -n old-k8s-version-20210915192720-498219
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (434.29s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20210915192839-498219 -n default-k8s-different-port-20210915192839-498219
start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20210915192839-498219 -n default-k8s-different-port-20210915192839-498219: exit status 7 (113.23163ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:224: status error: exit status 7 (may be ok)
start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p default-k8s-different-port-20210915192839-498219 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop (0.23s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/SecondStart (354.66s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/SecondStart
start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-different-port-20210915192839-498219 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.1
E0915 19:30:24.629673  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:30:27.190100  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:30:29.510816  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:30:29.516088  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:30:29.526324  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:30:29.546565  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:30:29.586828  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:30:29.667096  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:30:29.828162  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:30:30.148582  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:30:30.789278  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:30:32.070112  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:30:32.310574  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:30:34.630563  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:30:39.751469  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:30:42.551310  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:30:49.992170  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:03.032227  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:04.122511  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:04.127765  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:04.138021  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:04.158292  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:04.198542  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:04.278837  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:04.439853  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:04.760669  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:05.401528  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:06.681828  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:09.242786  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:10.473248  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:14.363852  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:24.604539  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:42.364041  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:42.369348  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:42.379580  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:42.399814  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:42.440073  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:42.520394  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:42.680691  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:43.001249  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:43.641507  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:43.993311  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:44.922355  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:45.085753  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:47.482665  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:51.433778  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:52.603483  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:31:56.838334  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:56.843552  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:56.853864  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:56.874807  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:56.915357  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:56.996304  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:57.156477  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:57.477051  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:58.117556  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:31:59.397693  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:32:01.958682  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:32:02.843845  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:32:07.079599  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:32:17.319986  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:32:23.324983  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:32:26.046779  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:32:37.800631  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:32:45.673082  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:32:45.678379  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:32:45.688608  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:32:45.708863  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:32:45.749138  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:32:45.829444  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:32:45.989627  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:32:46.309966  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:32:46.951127  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:32:48.231496  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:32:50.791849  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:32:55.912525  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:33:04.285970  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:05.914280  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:06.153128  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:33:13.353973  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:33:18.761300  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:33:19.092571  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:19.097854  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:19.108086  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:19.128330  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:19.168597  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:19.248827  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:19.409548  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:19.730121  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:20.371031  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:21.651230  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:24.211889  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:26.633343  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:33:29.332805  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:39.573688  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:33:47.967912  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
E0915 19:34:00.054674  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory
E0915 19:34:07.593642  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory
E0915 19:34:25.846697  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184214-498219/client.crt: no such file or directory
E0915 19:34:26.206991  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
E0915 19:34:33.724587  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184714-498219/client.crt: no such file or directory
E0915 19:34:40.682132  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:34:41.015044  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191717-498219/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/default-k8s-different-port/serial/SecondStart
start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-different-port-20210915192839-498219 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.1: (5m54.168686129s)
start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20210915192839-498219 -n default-k8s-different-port-20210915192839-498219
--- PASS: TestStartStop/group/default-k8s-different-port/serial/SecondStart (354.66s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (5.02s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:259: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-lh9qs" [64d1dd65-0fe2-4220-a00f-10f5632ab098] Running
start_stop_delete_test.go:259: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.014063068s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (5.02s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.21s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-lh9qs" [64d1dd65-0fe2-4220-a00f-10f5632ab098] Running

                                                
                                                
=== CONT  TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.007031451s
start_stop_delete_test.go:276: (dbg) Run:  kubectl --context no-preload-20210915192741-498219 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.21s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (5.02s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:259: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-hrm8h" [1160ed25-1665-4a17-808b-f996e637b885] Running

                                                
                                                
=== CONT  TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:259: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.016027939s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (5.02s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.37s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p no-preload-20210915192741-498219 "sudo crictl images -o json"
E0915 19:35:22.070817  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191717-498219/client.crt: no such file or directory
start_stop_delete_test.go:289: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5
start_stop_delete_test.go:289: Found non-minikube image: library/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.37s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.01s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p no-preload-20210915192741-498219 --alsologtostderr -v=1
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-20210915192741-498219 -n no-preload-20210915192741-498219
start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-20210915192741-498219 -n no-preload-20210915192741-498219: exit status 2 (425.395181ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:296: status error: exit status 2 (may be ok)
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-20210915192741-498219 -n no-preload-20210915192741-498219
start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-20210915192741-498219 -n no-preload-20210915192741-498219: exit status 2 (400.517967ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:296: status error: exit status 2 (may be ok)
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p no-preload-20210915192741-498219 --alsologtostderr -v=1

                                                
                                                
=== CONT  TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-20210915192741-498219 -n no-preload-20210915192741-498219
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-20210915192741-498219 -n no-preload-20210915192741-498219
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.01s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.09s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-hrm8h" [1160ed25-1665-4a17-808b-f996e637b885] Running

                                                
                                                
=== CONT  TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.006747609s
start_stop_delete_test.go:276: (dbg) Run:  kubectl --context embed-certs-20210915192805-498219 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.09s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.39s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p embed-certs-20210915192805-498219 "sudo crictl images -o json"
start_stop_delete_test.go:289: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5
start_stop_delete_test.go:289: Found non-minikube image: library/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.39s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (3.51s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p embed-certs-20210915192805-498219 --alsologtostderr -v=1

                                                
                                                
=== CONT  TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20210915192805-498219 -n embed-certs-20210915192805-498219
start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20210915192805-498219 -n embed-certs-20210915192805-498219: exit status 2 (430.182866ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:296: status error: exit status 2 (may be ok)
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-20210915192805-498219 -n embed-certs-20210915192805-498219
start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-20210915192805-498219 -n embed-certs-20210915192805-498219: exit status 2 (415.435121ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:296: status error: exit status 2 (may be ok)
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p embed-certs-20210915192805-498219 --alsologtostderr -v=1
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20210915192805-498219 -n embed-certs-20210915192805-498219
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-20210915192805-498219 -n embed-certs-20210915192805-498219
--- PASS: TestStartStop/group/embed-certs/serial/Pause (3.51s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (55.92s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-20210915193529-498219 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubelet.network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.2-rc.0
E0915 19:35:29.510622  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191719-498219/client.crt: no such file or directory
E0915 19:35:29.514770  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191718-498219/client.crt: no such file or directory

                                                
                                                
=== CONT  TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-20210915193529-498219 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubelet.network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.2-rc.0: (55.922763028s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (55.92s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop (5.04s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:259: (dbg) TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-gvqpn" [91f658a6-c8d5-4b09-8443-5a1180adcbec] Running
start_stop_delete_test.go:259: (dbg) TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.033043123s
--- PASS: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop (5.04s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop (5.08s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-gvqpn" [91f658a6-c8d5-4b09-8443-5a1180adcbec] Running

                                                
                                                
=== CONT  TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.005883235s
start_stop_delete_test.go:276: (dbg) Run:  kubectl --context default-k8s-different-port-20210915192839-498219 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop (5.08s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.61s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-20210915193529-498219 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:196: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.61s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (20.83s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p newest-cni-20210915193529-498219 --alsologtostderr -v=3

                                                
                                                
=== CONT  TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p newest-cni-20210915193529-498219 --alsologtostderr -v=3: (20.834290014s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (20.83s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/VerifyKubernetesImages (0.36s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p default-k8s-different-port-20210915192839-498219 "sudo crictl images -o json"
start_stop_delete_test.go:289: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5
start_stop_delete_test.go:289: Found non-minikube image: library/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-different-port/serial/VerifyKubernetesImages (0.36s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-different-port/serial/Pause (2.97s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-different-port/serial/Pause
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p default-k8s-different-port-20210915192839-498219 --alsologtostderr -v=1
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20210915192839-498219 -n default-k8s-different-port-20210915192839-498219
start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20210915192839-498219 -n default-k8s-different-port-20210915192839-498219: exit status 2 (386.003203ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:296: status error: exit status 2 (may be ok)
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-different-port-20210915192839-498219 -n default-k8s-different-port-20210915192839-498219
start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-different-port-20210915192839-498219 -n default-k8s-different-port-20210915192839-498219: exit status 2 (401.488348ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:296: status error: exit status 2 (may be ok)
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p default-k8s-different-port-20210915192839-498219 --alsologtostderr -v=1
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20210915192839-498219 -n default-k8s-different-port-20210915192839-498219
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-different-port-20210915192839-498219 -n default-k8s-different-port-20210915192839-498219
E0915 19:36:31.808441  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191719-498219/client.crt: no such file or directory
--- PASS: TestStartStop/group/default-k8s-different-port/serial/Pause (2.97s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-20210915193529-498219 -n newest-cni-20210915193529-498219
start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-20210915193529-498219 -n newest-cni-20210915193529-498219: exit status 7 (94.489956ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:224: status error: exit status 7 (may be ok)
start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p newest-cni-20210915193529-498219 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.19s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (35.73s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-20210915193529-498219 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubelet.network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.2-rc.0
E0915 19:36:56.837718  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
E0915 19:37:10.048091  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191717-498219/client.crt: no such file or directory
start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-20210915193529-498219 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubelet.network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.2-rc.0: (35.329847944s)
start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-20210915193529-498219 -n newest-cni-20210915193529-498219
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (35.73s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:258: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:269: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.37s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p newest-cni-20210915193529-498219 "sudo crictl images -o json"
start_stop_delete_test.go:289: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.37s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (2.73s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p newest-cni-20210915193529-498219 --alsologtostderr -v=1
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-20210915193529-498219 -n newest-cni-20210915193529-498219
start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-20210915193529-498219 -n newest-cni-20210915193529-498219: exit status 2 (381.071373ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:296: status error: exit status 2 (may be ok)
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-20210915193529-498219 -n newest-cni-20210915193529-498219
start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-20210915193529-498219 -n newest-cni-20210915193529-498219: exit status 2 (382.884204ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:296: status error: exit status 2 (may be ok)
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p newest-cni-20210915193529-498219 --alsologtostderr -v=1
E0915 19:37:24.523057  498219 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12425-494818-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191719-498219/client.crt: no such file or directory
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-20210915193529-498219 -n newest-cni-20210915193529-498219
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-20210915193529-498219 -n newest-cni-20210915193529-498219
--- PASS: TestStartStop/group/newest-cni/serial/Pause (2.73s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.01s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:259: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:343: "kubernetes-dashboard-5d8978d65d-zxhfr" [312e2ced-165c-11ec-9423-0242c0a83102] Running

                                                
                                                
=== CONT  TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:259: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.011161477s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.01s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.21s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:343: "kubernetes-dashboard-5d8978d65d-zxhfr" [312e2ced-165c-11ec-9423-0242c0a83102] Running
start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.005672859s
start_stop_delete_test.go:276: (dbg) Run:  kubectl --context old-k8s-version-20210915192720-498219 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.21s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.36s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p old-k8s-version-20210915192720-498219 "sudo crictl images -o json"
start_stop_delete_test.go:289: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5
start_stop_delete_test.go:289: Found non-minikube image: library/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.36s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (2.91s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p old-k8s-version-20210915192720-498219 --alsologtostderr -v=1
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20210915192720-498219 -n old-k8s-version-20210915192720-498219
start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20210915192720-498219 -n old-k8s-version-20210915192720-498219: exit status 2 (375.714286ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:296: status error: exit status 2 (may be ok)
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-20210915192720-498219 -n old-k8s-version-20210915192720-498219
start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-20210915192720-498219 -n old-k8s-version-20210915192720-498219: exit status 2 (373.769517ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:296: status error: exit status 2 (may be ok)
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p old-k8s-version-20210915192720-498219 --alsologtostderr -v=1
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20210915192720-498219 -n old-k8s-version-20210915192720-498219
start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-20210915192720-498219 -n old-k8s-version-20210915192720-498219
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (2.91s)

                                                
                                    

Test skip (24/274)

x
+
TestDownloadOnly/v1.14.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.14.0/cached-images
aaa_download_only_test.go:120: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.14.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.14.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.14.0/binaries
aaa_download_only_test.go:139: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.14.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.14.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.14.0/kubectl
aaa_download_only_test.go:155: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.14.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.22.1/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.22.1/cached-images
aaa_download_only_test.go:120: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.22.1/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.22.1/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.22.1/binaries
aaa_download_only_test.go:139: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.22.1/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.22.1/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.22.1/kubectl
aaa_download_only_test.go:155: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.22.1/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.22.2-rc.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.22.2-rc.0/cached-images
aaa_download_only_test.go:120: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.22.2-rc.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.22.2-rc.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.22.2-rc.0/binaries
aaa_download_only_test.go:139: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.22.2-rc.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.22.2-rc.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.22.2-rc.0/kubectl
aaa_download_only_test.go:155: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.22.2-rc.0/kubectl (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:36: skipping: only runs with docker container runtime, currently testing containerd
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:115: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:188: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:564: only validate docker env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:647: only validate podman env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:97: DNS forwarding is supported for darwin only now, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:97: DNS forwarding is supported for darwin only now, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:97: DNS forwarding is supported for darwin only now, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:35: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:39: Only test none driver.
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:44: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:44: skaffold requires docker-env, currently testing containerd container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (0.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:89: Skipping the test as containerd container runtimes requires CNI
helpers_test.go:176: Cleaning up "kubenet-20210915191717-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p kubenet-20210915191717-498219
--- SKIP: TestNetworkPlugins/group/kubenet (0.33s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel
net_test.go:77: flannel is not yet compatible with Docker driver: iptables v1.8.3 (legacy): Couldn't load target `CNI-x': No such file or directory
helpers_test.go:176: Cleaning up "flannel-20210915191717-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p flannel-20210915191717-498219
--- SKIP: TestNetworkPlugins/group/flannel (0.31s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.55s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:176: Cleaning up "disable-driver-mounts-20210915192838-498219" profile ...
helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p disable-driver-mounts-20210915192838-498219
--- SKIP: TestStartStop/group/disable-driver-mounts (0.55s)

                                                
                                    
Copied to clipboard