=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:46: (dbg) Run:  out/minikube-windows-amd64.exe start -p docker-flags-20211231112605-1576 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker

E1231 11:26:05.364782    1576 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\skaffold-20211231110743-1576\client.crt: The system cannot find the path specified.

=== CONT  TestDockerFlags

docker_test.go:46: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p docker-flags-20211231112605-1576 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker: exit status 80 (7m43.6892677s)

-- stdout --

	* [docker-flags-20211231112605-1576] minikube v1.24.0 on Microsoft Windows 10 Enterprise N 10.0.18363 Build 18363

	  - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	  - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	  - MINIKUBE_LOCATION=12739

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	* Using the docker driver based on user configuration

	* Starting control plane node docker-flags-20211231112605-1576 in cluster docker-flags-20211231112605-1576

	* Pulling base image ...

	* Creating docker container (CPUs=2, Memory=2048MB) ...

	* docker "docker-flags-20211231112605-1576" container is missing, will recreate.

	* Creating docker container (CPUs=2, Memory=2048MB) ...

-- /stdout --

** stderr ** 

	I1231 11:26:05.289990    4668 out.go:297] Setting OutFile to fd 1752 ...

	I1231 11:26:05.365677    4668 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 11:26:05.365677    4668 out.go:310] Setting ErrFile to fd 1808...

	I1231 11:26:05.365677    4668 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 11:26:05.381702    4668 out.go:304] Setting JSON to false

	I1231 11:26:05.383694    4668 start.go:112] hostinfo: {"hostname":"minikube7","uptime":36406,"bootTime":1640913559,"procs":160,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.18363 Build 18363","kernelVersion":"10.0.18363 Build 18363","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f66ed2ea-6c04-4a6b-8eea-b2fb0953e990"}

	W1231 11:26:05.383694    4668 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1231 11:26:05.392701    4668 out.go:176] * [docker-flags-20211231112605-1576] minikube v1.24.0 on Microsoft Windows 10 Enterprise N 10.0.18363 Build 18363

	I1231 11:26:05.392701    4668 notify.go:174] Checking for updates...

	I1231 11:26:05.396677    4668 out.go:176]   - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 11:26:05.398678    4668 out.go:176]   - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	I1231 11:26:05.401687    4668 out.go:176]   - MINIKUBE_LOCATION=12739

	I1231 11:26:05.404679    4668 out.go:176]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1231 11:26:05.405675    4668 config.go:176] Loaded profile config "cert-expiration-20211231112522-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.1

	I1231 11:26:05.405675    4668 config.go:176] Loaded profile config "kubernetes-upgrade-20211231111918-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.2-rc.0

	I1231 11:26:05.405675    4668 config.go:176] Loaded profile config "missing-upgrade-20211231112327-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I1231 11:26:05.406673    4668 driver.go:344] Setting default libvirt URI to qemu:///system

	I1231 11:26:08.404371    4668 docker.go:132] docker version: linux-20.10.11

	I1231 11:26:08.411360    4668 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:26:10.953169    4668 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.5415863s)

	I1231 11:26:10.956404    4668 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:79 OomKillDisable:true NGoroutines:65 SystemTime:2021-12-31 11:26:09.7941576 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_

bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:26:11.185097    4668 out.go:176] * Using the docker driver based on user configuration

	I1231 11:26:11.185166    4668 start.go:280] selected driver: docker

	I1231 11:26:11.185166    4668 start.go:795] validating driver "docker" against <nil>

	I1231 11:26:11.185259    4668 start.go:806] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I1231 11:26:11.185320    4668 start.go:1498] auto setting extra-config to "kubelet.global-housekeeping-interval=60m".

	I1231 11:26:11.185320    4668 start.go:1498] auto setting extra-config to "kubelet.housekeeping-interval=5m".

	I1231 11:26:11.264067    4668 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:26:13.636564    4668 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.3724867s)

	I1231 11:26:13.637147    4668 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:80 OomKillDisable:true NGoroutines:65 SystemTime:2021-12-31 11:26:12.5651119 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_

bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:26:13.637382    4668 start_flags.go:284] no existing cluster config was found, will generate one from the flags 

	I1231 11:26:13.637869    4668 start_flags.go:805] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]

	I1231 11:26:13.637989    4668 cni.go:93] Creating CNI manager for ""

	I1231 11:26:13.638057    4668 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:26:13.638057    4668 start_flags.go:298] config:

	{Name:docker-flags-20211231112605-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.1 ClusterName:docker-flags-20211231112605-1576 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[

] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker}

	I1231 11:26:14.194059    4668 out.go:176] * Starting control plane node docker-flags-20211231112605-1576 in cluster docker-flags-20211231112605-1576

	I1231 11:26:14.194796    4668 cache.go:118] Beginning downloading kic base image for docker with docker

	I1231 11:26:14.295717    4668 out.go:176] * Pulling base image ...

	I1231 11:26:14.295717    4668 preload.go:132] Checking if preload exists for k8s version v1.23.1 and runtime docker

	I1231 11:26:14.295717    4668 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b in local docker daemon

	I1231 11:26:14.295717    4668 preload.go:148] Found local preload: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.1-docker-overlay2-amd64.tar.lz4

	I1231 11:26:14.295717    4668 cache.go:57] Caching tarball of preloaded images

	I1231 11:26:14.296722    4668 preload.go:174] Found C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1231 11:26:14.296722    4668 cache.go:60] Finished verifying existence of preloaded tar for  v1.23.1 on docker

	I1231 11:26:14.296722    4668 profile.go:147] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\docker-flags-20211231112605-1576\config.json ...

	I1231 11:26:14.296722    4668 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\docker-flags-20211231112605-1576\config.json: {Name:mkf83022e84666e044c1c4162a92500695207450 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:26:15.624546    4668 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b in local docker daemon, skipping pull

	I1231 11:26:15.624571    4668 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b exists in daemon, skipping load

	I1231 11:26:15.624681    4668 cache.go:206] Successfully downloaded all kic artifacts

	I1231 11:26:15.626942    4668 start.go:313] acquiring machines lock for docker-flags-20211231112605-1576: {Name:mk4a8c6907288cbb050943815baffa2c2239f211 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1231 11:26:15.627422    4668 start.go:317] acquired machines lock for "docker-flags-20211231112605-1576" in 480.1µs

	I1231 11:26:15.627607    4668 start.go:89] Provisioning new machine with config: &{Name:docker-flags-20211231112605-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.1 ClusterName:docker-flags-2021123111260

5-1576 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.23.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountG

ID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker} &{Name: IP: Port:8443 KubernetesVersion:v1.23.1 ControlPlane:true Worker:true}

	I1231 11:26:15.627607    4668 start.go:126] createHost starting for "" (driver="docker")

	I1231 11:26:15.761554    4668 out.go:203] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I1231 11:26:15.761808    4668 start.go:160] libmachine.API.Create for "docker-flags-20211231112605-1576" (driver="docker")

	I1231 11:26:15.761808    4668 client.go:168] LocalClient.Create starting

	I1231 11:26:15.762623    4668 main.go:130] libmachine: Reading certificate data from C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem

	I1231 11:26:15.762841    4668 main.go:130] libmachine: Decoding PEM data...

	I1231 11:26:15.762841    4668 main.go:130] libmachine: Parsing certificate...

	I1231 11:26:15.762841    4668 main.go:130] libmachine: Reading certificate data from C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem

	I1231 11:26:15.762841    4668 main.go:130] libmachine: Decoding PEM data...

	I1231 11:26:15.762841    4668 main.go:130] libmachine: Parsing certificate...

	I1231 11:26:15.771774    4668 cli_runner.go:133] Run: docker network inspect docker-flags-20211231112605-1576 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1231 11:26:17.163345    4668 cli_runner.go:180] docker network inspect docker-flags-20211231112605-1576 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1231 11:26:17.163407    4668 cli_runner.go:186] Completed: docker network inspect docker-flags-20211231112605-1576 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": (1.3908881s)

	I1231 11:26:17.171619    4668 network_create.go:254] running [docker network inspect docker-flags-20211231112605-1576] to gather additional debugging logs...

	I1231 11:26:17.171619    4668 cli_runner.go:133] Run: docker network inspect docker-flags-20211231112605-1576

	W1231 11:26:18.600040    4668 cli_runner.go:180] docker network inspect docker-flags-20211231112605-1576 returned with exit code 1

	I1231 11:26:18.600040    4668 cli_runner.go:186] Completed: docker network inspect docker-flags-20211231112605-1576: (1.4284159s)

	I1231 11:26:18.600040    4668 network_create.go:257] error running [docker network inspect docker-flags-20211231112605-1576]: docker network inspect docker-flags-20211231112605-1576: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: docker-flags-20211231112605-1576

	I1231 11:26:18.600040    4668 network_create.go:259] output of [docker network inspect docker-flags-20211231112605-1576]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: docker-flags-20211231112605-1576

	** /stderr **

	I1231 11:26:18.610562    4668 cli_runner.go:133] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1231 11:26:19.994299    4668 cli_runner.go:186] Completed: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": (1.3831797s)

	I1231 11:26:20.017299    4668 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc0001526f0] misses:0}

	I1231 11:26:20.017299    4668 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I1231 11:26:20.017299    4668 network_create.go:106] attempt to create docker network docker-flags-20211231112605-1576 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...

	I1231 11:26:20.023298    4668 cli_runner.go:133] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true docker-flags-20211231112605-1576

	I1231 11:26:23.203524    4668 cli_runner.go:186] Completed: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true docker-flags-20211231112605-1576: (3.1802128s)

	I1231 11:26:23.203524    4668 network_create.go:90] docker network docker-flags-20211231112605-1576 192.168.49.0/24 created

	I1231 11:26:23.203524    4668 kic.go:106] calculated static IP "192.168.49.2" for the "docker-flags-20211231112605-1576" container

	I1231 11:26:23.217478    4668 cli_runner.go:133] Run: docker ps -a --format {{.Names}}

	I1231 11:26:24.681549    4668 cli_runner.go:186] Completed: docker ps -a --format {{.Names}}: (1.464065s)

	I1231 11:26:24.688892    4668 cli_runner.go:133] Run: docker volume create docker-flags-20211231112605-1576 --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true

	I1231 11:26:26.106414    4668 cli_runner.go:186] Completed: docker volume create docker-flags-20211231112605-1576 --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true: (1.4174647s)

	I1231 11:26:26.106631    4668 oci.go:102] Successfully created a docker volume docker-flags-20211231112605-1576

	I1231 11:26:26.114930    4668 cli_runner.go:133] Run: docker run --rm --name docker-flags-20211231112605-1576-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --entrypoint /usr/bin/test -v docker-flags-20211231112605-1576:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b -d /var/lib

	I1231 11:26:40.189173    4668 cli_runner.go:186] Completed: docker run --rm --name docker-flags-20211231112605-1576-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --entrypoint /usr/bin/test -v docker-flags-20211231112605-1576:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b -d /var/lib: (14.0741842s)

	I1231 11:26:40.189173    4668 oci.go:106] Successfully prepared a docker volume docker-flags-20211231112605-1576

	I1231 11:26:40.189341    4668 preload.go:132] Checking if preload exists for k8s version v1.23.1 and runtime docker

	I1231 11:26:40.189429    4668 kic.go:179] Starting extracting preloaded images to volume ...

	I1231 11:26:40.198620    4668 cli_runner.go:133] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v docker-flags-20211231112605-1576:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b -I lz4 -xf /preloaded.tar -C /extractDir

	I1231 11:27:16.892606    4668 cli_runner.go:186] Completed: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v docker-flags-20211231112605-1576:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b -I lz4 -xf /preloaded.tar -C /extractDir: (36.6938312s)

	I1231 11:27:16.892606    4668 kic.go:188] duration metric: took 36.703022 seconds to extract preloaded images to volume

	I1231 11:27:16.898252    4668 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:27:19.380581    4668 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.482318s)

	I1231 11:27:19.380581    4668 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:3 ContainersRunning:1 ContainersPaused:0 ContainersStopped:2 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:63 OomKillDisable:true NGoroutines:64 SystemTime:2021-12-31 11:27:18.222321 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64

IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_b

ps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:27:19.386565    4668 cli_runner.go:133] Run: docker info --format "'{{json .SecurityOptions}}'"

	I1231 11:27:21.923463    4668 cli_runner.go:186] Completed: docker info --format "'{{json .SecurityOptions}}'": (2.5367353s)

	I1231 11:27:21.931907    4668 cli_runner.go:133] Run: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname docker-flags-20211231112605-1576 --name docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --network docker-flags-20211231112605-1576 --ip 192.168.49.2 --volume docker-flags-20211231112605-1576:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b

	W1231 11:27:28.806009    4668 cli_runner.go:180] docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname docker-flags-20211231112605-1576 --name docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --network docker-flags-20211231112605-1576 --ip 192.168.49.2 --volume docker-flags-20211231112605-1576:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b returned with exit code 125

	I1231 11:27:28.806009    4668 cli_runner.go:186] Completed: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname docker-flags-20211231112605-1576 --name docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --network docker-flags-20211231112605-1576 --ip 192.168.49.2 --volume docker-flags-20211231112605-1576:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b: (6.8734634s)

	I1231 11:27:28.806009    4668 client.go:171] LocalClient.Create took 1m13.0438926s

	I1231 11:27:30.815952    4668 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1231 11:27:30.820762    4668 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576

	W1231 11:27:32.268754    4668 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576 returned with exit code 1

	I1231 11:27:32.268754    4668 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576: (1.4479863s)

	I1231 11:27:32.268754    4668 retry.go:31] will retry after 276.165072ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I1231 11:27:32.556469    4668 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576

	W1231 11:27:33.976755    4668 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576 returned with exit code 1

	I1231 11:27:33.976755    4668 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576: (1.4202798s)

	W1231 11:27:33.977095    4668 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W1231 11:27:33.977209    4668 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I1231 11:27:33.977309    4668 start.go:129] duration metric: createHost completed in 1m18.3493705s

	I1231 11:27:33.977309    4668 start.go:80] releasing machines lock for "docker-flags-20211231112605-1576", held for 1m18.3494065s

	W1231 11:27:33.977558    4668 start.go:566] error starting host: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname docker-flags-20211231112605-1576 --name docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --network docker-flags-20211231112605-1576 --ip 192.168.49.2 --volume docker-flags-20211231112605-1576:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f3

90a0092f488f6a1c30865f571c3b6388f9f56f9b: exit status 125

	stdout:

	3d269d7cc6b66592a81c578bd850ab389c7af0a35336082a05e7bdb87a84e10d

	stderr:

	docker: Error response from daemon: network docker-flags-20211231112605-1576 not found.

	I1231 11:27:33.991533    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:27:35.419052    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4272572s)

	W1231 11:27:35.703708    4668 start.go:571] delete host: Docker machine "docker-flags-20211231112605-1576" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	W1231 11:27:35.704855    4668 out.go:241] ! StartHost failed, but will try again: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname docker-flags-20211231112605-1576 --name docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --network docker-flags-20211231112605-1576 --ip 192.168.49.2 --volume docker-flags-20211231112605-1576:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897ed

c9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b: exit status 125

	stdout:

	3d269d7cc6b66592a81c578bd850ab389c7af0a35336082a05e7bdb87a84e10d

	stderr:

	docker: Error response from daemon: network docker-flags-20211231112605-1576 not found.

	! StartHost failed, but will try again: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname docker-flags-20211231112605-1576 --name docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --network docker-flags-20211231112605-1576 --ip 192.168.49.2 --volume docker-flags-20211231112605-1576:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571

c3b6388f9f56f9b: exit status 125

	stdout:

	3d269d7cc6b66592a81c578bd850ab389c7af0a35336082a05e7bdb87a84e10d

	stderr:

	docker: Error response from daemon: network docker-flags-20211231112605-1576 not found.

	I1231 11:27:35.705340    4668 start.go:581] Will try again in 5 seconds ...

	I1231 11:27:40.706140    4668 start.go:313] acquiring machines lock for docker-flags-20211231112605-1576: {Name:mk4a8c6907288cbb050943815baffa2c2239f211 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1231 11:27:40.706367    4668 start.go:317] acquired machines lock for "docker-flags-20211231112605-1576" in 154.5µs

	I1231 11:27:40.706703    4668 start.go:93] Skipping create...Using existing machine configuration

	I1231 11:27:40.706870    4668 fix.go:55] fixHost starting: 

	I1231 11:27:40.727747    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:27:42.111340    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3835868s)

	I1231 11:27:42.111340    4668 fix.go:108] recreateIfNeeded on docker-flags-20211231112605-1576: state= err=<nil>

	I1231 11:27:42.111340    4668 fix.go:113] machineExists: false. err=machine does not exist

	I1231 11:27:42.115357    4668 out.go:176] * docker "docker-flags-20211231112605-1576" container is missing, will recreate.

	I1231 11:27:42.115357    4668 delete.go:124] DEMOLISHING docker-flags-20211231112605-1576 ...

	I1231 11:27:42.126343    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:27:43.572458    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4461089s)

	I1231 11:27:43.572458    4668 stop.go:79] host is in state 

	I1231 11:27:43.572458    4668 main.go:130] libmachine: Stopping "docker-flags-20211231112605-1576"...

	I1231 11:27:43.591947    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:27:45.059681    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4677279s)

	I1231 11:27:45.082650    4668 kic_runner.go:93] Run: systemctl --version

	I1231 11:27:45.082650    4668 kic_runner.go:114] Args: [docker exec --privileged docker-flags-20211231112605-1576 systemctl --version]

	I1231 11:27:46.683264    4668 kic_runner.go:93] Run: sudo service kubelet stop

	I1231 11:27:46.683264    4668 kic_runner.go:114] Args: [docker exec --privileged docker-flags-20211231112605-1576 sudo service kubelet stop]

	I1231 11:27:48.176102    4668 openrc.go:165] stop output: 

	** stderr ** 

	Error response from daemon: Container 3d269d7cc6b66592a81c578bd850ab389c7af0a35336082a05e7bdb87a84e10d is not running

	** /stderr **

	W1231 11:27:48.176102    4668 kic.go:443] couldn't stop kubelet. will continue with stop anyways: sudo service kubelet stop: exit status 1

	stdout:

	stderr:

	Error response from daemon: Container 3d269d7cc6b66592a81c578bd850ab389c7af0a35336082a05e7bdb87a84e10d is not running

	I1231 11:27:48.190609    4668 kic_runner.go:93] Run: sudo service kubelet stop

	I1231 11:27:48.190609    4668 kic_runner.go:114] Args: [docker exec --privileged docker-flags-20211231112605-1576 sudo service kubelet stop]

	I1231 11:27:49.723559    4668 openrc.go:165] stop output: 

	** stderr ** 

	Error response from daemon: Container 3d269d7cc6b66592a81c578bd850ab389c7af0a35336082a05e7bdb87a84e10d is not running

	** /stderr **

	W1231 11:27:49.723734    4668 kic.go:445] couldn't force stop kubelet. will continue with stop anyways: sudo service kubelet stop: exit status 1

	stdout:

	stderr:

	Error response from daemon: Container 3d269d7cc6b66592a81c578bd850ab389c7af0a35336082a05e7bdb87a84e10d is not running

	I1231 11:27:49.737661    4668 kic_runner.go:93] Run: docker ps -a --filter=name=k8s_.*_(kube-system|kubernetes-dashboard|storage-gluster|istio-operator)_ --format={{.ID}}

	I1231 11:27:49.737661    4668 kic_runner.go:114] Args: [docker exec --privileged docker-flags-20211231112605-1576 docker ps -a --filter=name=k8s_.*_(kube-system|kubernetes-dashboard|storage-gluster|istio-operator)_ --format={{.ID}}]

	I1231 11:27:51.481502    4668 kic.go:456] unable list containers : docker: docker ps -a --filter=name=k8s_.*_(kube-system|kubernetes-dashboard|storage-gluster|istio-operator)_ --format={{.ID}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Container 3d269d7cc6b66592a81c578bd850ab389c7af0a35336082a05e7bdb87a84e10d is not running

	I1231 11:27:51.481627    4668 kic.go:466] successfully stopped kubernetes!

	I1231 11:27:51.495887    4668 kic_runner.go:93] Run: pgrep kube-apiserver

	I1231 11:27:51.495887    4668 kic_runner.go:114] Args: [docker exec --privileged docker-flags-20211231112605-1576 pgrep kube-apiserver]

	I1231 11:27:54.685354    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:27:55.988275    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3029155s)

	I1231 11:27:59.001770    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:00.372081    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3703054s)

	I1231 11:28:03.387317    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:04.749861    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3625383s)

	I1231 11:28:07.762809    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:09.101132    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3383164s)

	I1231 11:28:12.112794    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:13.383807    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.2710076s)

	I1231 11:28:16.394526    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:17.693061    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.2985295s)

	I1231 11:28:20.704291    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:21.994246    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.28995s)

	I1231 11:28:25.006812    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:26.352209    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3453919s)

	I1231 11:28:29.362954    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:30.625000    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.2620412s)

	I1231 11:28:33.635268    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:34.926606    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.2912907s)

	I1231 11:28:37.936905    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:39.224662    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.287752s)

	I1231 11:28:42.236960    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:43.536994    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.2997134s)

	I1231 11:28:46.548181    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:47.815155    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.2669685s)

	I1231 11:28:50.827683    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:52.215205    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3874513s)

	I1231 11:28:55.230396    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:28:56.581807    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3514049s)

	I1231 11:28:59.595905    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:01.002084    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4061725s)

	I1231 11:29:04.013771    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:05.449209    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4354313s)

	I1231 11:29:08.463527    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:09.912682    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4491488s)

	I1231 11:29:12.926413    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:14.302092    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3756731s)

	I1231 11:29:17.313759    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:18.772447    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4586811s)

	I1231 11:29:21.789538    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:23.128093    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3378724s)

	I1231 11:29:26.140880    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:27.500740    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3598542s)

	I1231 11:29:30.515280    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:31.903487    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3880366s)

	I1231 11:29:34.915198    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:36.245084    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3298799s)

	I1231 11:29:39.256979    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:40.622106    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3649334s)

	I1231 11:29:43.635945    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:44.930989    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.2950384s)

	I1231 11:29:47.942974    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:49.221881    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.2787147s)

	I1231 11:29:52.234646    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:53.560209    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3254229s)

	I1231 11:29:56.574535    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:29:57.915171    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3402939s)

	I1231 11:30:00.931190    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:02.277139    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3457343s)

	I1231 11:30:05.292199    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:06.611272    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3190002s)

	I1231 11:30:09.623102    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:10.931934    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3087364s)

	I1231 11:30:13.943816    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:15.270801    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3257891s)

	I1231 11:30:18.282825    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:19.620436    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3372856s)

	I1231 11:30:22.632268    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:24.008771    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3764577s)

	I1231 11:30:27.019162    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:28.462083    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4429152s)

	I1231 11:30:31.474277    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:32.806654    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3322354s)

	I1231 11:30:35.823799    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:37.193611    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3697083s)

	I1231 11:30:40.205763    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:42.092095    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3483267s)

	I1231 11:30:45.104599    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:46.363755    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.2590952s)

	I1231 11:30:49.376382    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:50.698442    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3219605s)

	I1231 11:30:53.713610    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:55.043545    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.329773s)

	I1231 11:30:58.055862    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:30:59.317035    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.2610151s)

	I1231 11:31:02.328547    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:31:03.730334    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4015484s)

	I1231 11:31:06.758843    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:31:08.131759    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3728601s)

	I1231 11:31:11.143890    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:31:12.493866    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3487654s)

	I1231 11:31:15.505968    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:31:16.924292    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4183172s)

	I1231 11:31:19.937426    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:31:21.341439    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4040074s)

	I1231 11:31:24.362275    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:31:25.773571    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4112902s)

	I1231 11:31:28.791504    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:31:30.305264    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.513754s)

	I1231 11:31:33.317867    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:31:34.779966    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4620931s)

	I1231 11:31:37.799006    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:31:39.142880    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3438688s)

	I1231 11:31:42.155116    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:31:43.591449    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4362522s)

	I1231 11:31:46.607660    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:31:48.060083    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4523532s)

	I1231 11:31:51.074733    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:31:52.441083    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3663442s)

	I1231 11:31:55.451944    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:31:56.838031    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3860811s)

	I1231 11:31:59.851249    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:32:01.120265    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.2689442s)

	I1231 11:32:04.132559    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:32:05.521564    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3889991s)

	I1231 11:32:08.532636    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:32:09.947114    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4144721s)

	I1231 11:32:12.959973    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:32:14.362506    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.402475s)

	I1231 11:32:17.363049    4668 stop.go:59] stop err: Maximum number of retries (60) exceeded

	I1231 11:32:17.363049    4668 delete.go:129] stophost failed (probably ok): Temporary Error: stop: Maximum number of retries (60) exceeded

	I1231 11:32:17.381035    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:32:18.798818    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4177776s)

	W1231 11:32:18.798818    4668 delete.go:135] deletehost failed: Docker machine "docker-flags-20211231112605-1576" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I1231 11:32:18.804808    4668 cli_runner.go:133] Run: docker container inspect -f {{.Id}} docker-flags-20211231112605-1576

	I1231 11:32:20.242110    4668 cli_runner.go:186] Completed: docker container inspect -f {{.Id}} docker-flags-20211231112605-1576: (1.437296s)

	I1231 11:32:20.247105    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:32:21.605758    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.3576496s)

	I1231 11:32:21.611752    4668 cli_runner.go:133] Run: docker exec --privileged -t docker-flags-20211231112605-1576 /bin/bash -c "sudo init 0"

	W1231 11:32:23.154882    4668 cli_runner.go:180] docker exec --privileged -t docker-flags-20211231112605-1576 /bin/bash -c "sudo init 0" returned with exit code 1

	I1231 11:32:23.154882    4668 cli_runner.go:186] Completed: docker exec --privileged -t docker-flags-20211231112605-1576 /bin/bash -c "sudo init 0": (1.5431238s)

	I1231 11:32:23.154882    4668 oci.go:651] error shutdown docker-flags-20211231112605-1576: docker exec --privileged -t docker-flags-20211231112605-1576 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: Container 3d269d7cc6b66592a81c578bd850ab389c7af0a35336082a05e7bdb87a84e10d is not running

	I1231 11:32:24.168771    4668 cli_runner.go:133] Run: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}

	I1231 11:32:25.662059    4668 cli_runner.go:186] Completed: docker container inspect docker-flags-20211231112605-1576 --format={{.State.Status}}: (1.4932819s)

	I1231 11:32:25.662059    4668 oci.go:665] temporary error: container docker-flags-20211231112605-1576 status is  but expect it to be exited

	I1231 11:32:25.662059    4668 oci.go:671] Successfully shutdown container docker-flags-20211231112605-1576

	I1231 11:32:25.671701    4668 cli_runner.go:133] Run: docker rm -f -v docker-flags-20211231112605-1576

	I1231 11:32:27.281971    4668 cli_runner.go:186] Completed: docker rm -f -v docker-flags-20211231112605-1576: (1.6102634s)

	I1231 11:32:27.289981    4668 cli_runner.go:133] Run: docker container inspect -f {{.Id}} docker-flags-20211231112605-1576

	W1231 11:32:28.722363    4668 cli_runner.go:180] docker container inspect -f {{.Id}} docker-flags-20211231112605-1576 returned with exit code 1

	I1231 11:32:28.722404    4668 cli_runner.go:186] Completed: docker container inspect -f {{.Id}} docker-flags-20211231112605-1576: (1.4323502s)

	I1231 11:32:28.729896    4668 cli_runner.go:133] Run: docker network inspect docker-flags-20211231112605-1576 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1231 11:32:30.032253    4668 cli_runner.go:180] docker network inspect docker-flags-20211231112605-1576 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1231 11:32:30.032253    4668 cli_runner.go:186] Completed: docker network inspect docker-flags-20211231112605-1576 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": (1.3022834s)

	I1231 11:32:30.037242    4668 network_create.go:254] running [docker network inspect docker-flags-20211231112605-1576] to gather additional debugging logs...

	I1231 11:32:30.037242    4668 cli_runner.go:133] Run: docker network inspect docker-flags-20211231112605-1576

	W1231 11:32:31.446134    4668 cli_runner.go:180] docker network inspect docker-flags-20211231112605-1576 returned with exit code 1

	I1231 11:32:31.446134    4668 cli_runner.go:186] Completed: docker network inspect docker-flags-20211231112605-1576: (1.4088s)

	I1231 11:32:31.446232    4668 network_create.go:257] error running [docker network inspect docker-flags-20211231112605-1576]: docker network inspect docker-flags-20211231112605-1576: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: docker-flags-20211231112605-1576

	I1231 11:32:31.446315    4668 network_create.go:259] output of [docker network inspect docker-flags-20211231112605-1576]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: docker-flags-20211231112605-1576

	** /stderr **

	W1231 11:32:31.447693    4668 delete.go:139] delete failed (probably ok) <nil>

	I1231 11:32:31.447693    4668 fix.go:120] Sleeping 1 second for extra luck!

	I1231 11:32:32.448682    4668 start.go:126] createHost starting for "" (driver="docker")

	I1231 11:32:32.593644    4668 out.go:203] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I1231 11:32:32.594548    4668 start.go:160] libmachine.API.Create for "docker-flags-20211231112605-1576" (driver="docker")

	I1231 11:32:32.594548    4668 client.go:168] LocalClient.Create starting

	I1231 11:32:32.595220    4668 main.go:130] libmachine: Reading certificate data from C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem

	I1231 11:32:32.595777    4668 main.go:130] libmachine: Decoding PEM data...

	I1231 11:32:32.595868    4668 main.go:130] libmachine: Parsing certificate...

	I1231 11:32:32.596117    4668 main.go:130] libmachine: Reading certificate data from C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem

	I1231 11:32:32.596253    4668 main.go:130] libmachine: Decoding PEM data...

	I1231 11:32:32.596253    4668 main.go:130] libmachine: Parsing certificate...

	I1231 11:32:32.604468    4668 cli_runner.go:133] Run: docker network inspect docker-flags-20211231112605-1576 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1231 11:32:33.919092    4668 cli_runner.go:180] docker network inspect docker-flags-20211231112605-1576 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1231 11:32:33.919187    4668 cli_runner.go:186] Completed: docker network inspect docker-flags-20211231112605-1576 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": (1.3145141s)

	I1231 11:32:33.926120    4668 network_create.go:254] running [docker network inspect docker-flags-20211231112605-1576] to gather additional debugging logs...

	I1231 11:32:33.926183    4668 cli_runner.go:133] Run: docker network inspect docker-flags-20211231112605-1576

	W1231 11:32:35.348250    4668 cli_runner.go:180] docker network inspect docker-flags-20211231112605-1576 returned with exit code 1

	I1231 11:32:35.502764    4668 cli_runner.go:186] Completed: docker network inspect docker-flags-20211231112605-1576: (1.4220129s)

	I1231 11:32:35.503129    4668 network_create.go:257] error running [docker network inspect docker-flags-20211231112605-1576]: docker network inspect docker-flags-20211231112605-1576: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: docker-flags-20211231112605-1576

	I1231 11:32:35.503227    4668 network_create.go:259] output of [docker network inspect docker-flags-20211231112605-1576]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: docker-flags-20211231112605-1576

	** /stderr **

	I1231 11:32:35.514312    4668 cli_runner.go:133] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1231 11:32:37.156429    4668 cli_runner.go:186] Completed: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": (1.6421102s)

	I1231 11:32:37.173434    4668 network.go:284] reusing subnet 192.168.49.0 that has expired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0001526f0] amended:false}} dirty:map[] misses:0}

	I1231 11:32:37.173434    4668 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I1231 11:32:37.173434    4668 network_create.go:106] attempt to create docker network docker-flags-20211231112605-1576 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...

	I1231 11:32:37.179429    4668 cli_runner.go:133] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true docker-flags-20211231112605-1576

	W1231 11:32:38.584891    4668 cli_runner.go:180] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true docker-flags-20211231112605-1576 returned with exit code 1

	I1231 11:32:38.584891    4668 cli_runner.go:186] Completed: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true docker-flags-20211231112605-1576: (1.4054556s)

	W1231 11:32:38.584891    4668 network_create.go:98] failed to create docker network docker-flags-20211231112605-1576 192.168.49.0/24, will retry: subnet is taken

	I1231 11:32:38.613546    4668 network.go:279] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0001526f0] amended:false}} dirty:map[] misses:0}

	I1231 11:32:38.613546    4668 network.go:238] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I1231 11:32:38.634017    4668 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0001526f0] amended:true}} dirty:map[192.168.49.0:0xc0001526f0 192.168.58.0:0xc0005da310] misses:0}

	I1231 11:32:38.634017    4668 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I1231 11:32:38.634017    4668 network_create.go:106] attempt to create docker network docker-flags-20211231112605-1576 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...

	I1231 11:32:38.642031    4668 cli_runner.go:133] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true docker-flags-20211231112605-1576

	W1231 11:32:40.140058    4668 cli_runner.go:180] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true docker-flags-20211231112605-1576 returned with exit code 1

	I1231 11:32:40.140058    4668 cli_runner.go:186] Completed: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true docker-flags-20211231112605-1576: (1.4979863s)

	W1231 11:32:40.140058    4668 network_create.go:98] failed to create docker network docker-flags-20211231112605-1576 192.168.58.0/24, will retry: subnet is taken

	I1231 11:32:40.165967    4668 network.go:279] skipping subnet 192.168.58.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0001526f0] amended:true}} dirty:map[192.168.49.0:0xc0001526f0 192.168.58.0:0xc0005da310] misses:1}

	I1231 11:32:40.165967    4668 network.go:238] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I1231 11:32:40.188823    4668 network.go:288] reserving subnet 192.168.67.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0001526f0] amended:true}} dirty:map[192.168.49.0:0xc0001526f0 192.168.58.0:0xc0005da310 192.168.67.0:0xc0003949f8] misses:1}

	I1231 11:32:40.188823    4668 network.go:235] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I1231 11:32:40.188982    4668 network_create.go:106] attempt to create docker network docker-flags-20211231112605-1576 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...

	I1231 11:32:40.198676    4668 cli_runner.go:133] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true docker-flags-20211231112605-1576

	W1231 11:32:41.561784    4668 cli_runner.go:180] docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true docker-flags-20211231112605-1576 returned with exit code 1

	I1231 11:32:41.561784    4668 cli_runner.go:186] Completed: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true docker-flags-20211231112605-1576: (1.3631031s)

	W1231 11:32:41.561949    4668 network_create.go:98] failed to create docker network docker-flags-20211231112605-1576 192.168.67.0/24, will retry: subnet is taken

	I1231 11:32:41.580853    4668 network.go:279] skipping subnet 192.168.67.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0001526f0] amended:true}} dirty:map[192.168.49.0:0xc0001526f0 192.168.58.0:0xc0005da310 192.168.67.0:0xc0003949f8] misses:2}

	I1231 11:32:41.580853    4668 network.go:238] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I1231 11:32:41.596846    4668 network.go:288] reserving subnet 192.168.76.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc0001526f0] amended:true}} dirty:map[192.168.49.0:0xc0001526f0 192.168.58.0:0xc0005da310 192.168.67.0:0xc0003949f8 192.168.76.0:0xc000152760] misses:2}

	I1231 11:32:41.596846    4668 network.go:235] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I1231 11:32:41.596846    4668 network_create.go:106] attempt to create docker network docker-flags-20211231112605-1576 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...

	I1231 11:32:41.602846    4668 cli_runner.go:133] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true docker-flags-20211231112605-1576

	I1231 11:32:44.517429    4668 cli_runner.go:186] Completed: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true docker-flags-20211231112605-1576: (2.9145709s)

	I1231 11:32:44.517429    4668 network_create.go:90] docker network docker-flags-20211231112605-1576 192.168.76.0/24 created

	I1231 11:32:44.517429    4668 kic.go:106] calculated static IP "192.168.76.2" for the "docker-flags-20211231112605-1576" container

	I1231 11:32:44.533465    4668 cli_runner.go:133] Run: docker ps -a --format {{.Names}}

	I1231 11:32:45.853929    4668 cli_runner.go:186] Completed: docker ps -a --format {{.Names}}: (1.320458s)

	I1231 11:32:45.859930    4668 cli_runner.go:133] Run: docker volume create docker-flags-20211231112605-1576 --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true

	I1231 11:32:47.221760    4668 cli_runner.go:186] Completed: docker volume create docker-flags-20211231112605-1576 --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true: (1.3618243s)

	I1231 11:32:47.221760    4668 oci.go:102] Successfully created a docker volume docker-flags-20211231112605-1576

	I1231 11:32:47.230738    4668 cli_runner.go:133] Run: docker run --rm --name docker-flags-20211231112605-1576-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --entrypoint /usr/bin/test -v docker-flags-20211231112605-1576:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b -d /var/lib

	I1231 11:32:51.765400    4668 cli_runner.go:186] Completed: docker run --rm --name docker-flags-20211231112605-1576-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --entrypoint /usr/bin/test -v docker-flags-20211231112605-1576:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b -d /var/lib: (4.5346432s)

	I1231 11:32:51.765400    4668 oci.go:106] Successfully prepared a docker volume docker-flags-20211231112605-1576

	I1231 11:32:51.765400    4668 preload.go:132] Checking if preload exists for k8s version v1.23.1 and runtime docker

	I1231 11:32:51.765400    4668 kic.go:179] Starting extracting preloaded images to volume ...

	I1231 11:32:51.771401    4668 cli_runner.go:133] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v docker-flags-20211231112605-1576:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b -I lz4 -xf /preloaded.tar -C /extractDir

	I1231 11:33:32.665216    4668 cli_runner.go:186] Completed: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v docker-flags-20211231112605-1576:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b -I lz4 -xf /preloaded.tar -C /extractDir: (40.8935233s)

	I1231 11:33:32.665263    4668 kic.go:188] duration metric: took 40.899695 seconds to extract preloaded images to volume

	I1231 11:33:32.671347    4668 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:33:35.122435    4668 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.450904s)

	I1231 11:33:35.122435    4668 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:3 ContainersRunning:1 ContainersPaused:0 ContainersStopped:2 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:66 OomKillDisable:true NGoroutines:56 SystemTime:2021-12-31 11:33:33.9509584 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_

bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:33:35.130529    4668 cli_runner.go:133] Run: docker info --format "'{{json .SecurityOptions}}'"

	I1231 11:33:37.842366    4668 cli_runner.go:186] Completed: docker info --format "'{{json .SecurityOptions}}'": (2.7118254s)

	I1231 11:33:37.860100    4668 cli_runner.go:133] Run: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname docker-flags-20211231112605-1576 --name docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --network docker-flags-20211231112605-1576 --ip 192.168.76.2 --volume docker-flags-20211231112605-1576:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b

	W1231 11:33:40.271035    4668 cli_runner.go:180] docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname docker-flags-20211231112605-1576 --name docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --network docker-flags-20211231112605-1576 --ip 192.168.76.2 --volume docker-flags-20211231112605-1576:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b returned with exit code 125

	I1231 11:33:40.271035    4668 cli_runner.go:186] Completed: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname docker-flags-20211231112605-1576 --name docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --network docker-flags-20211231112605-1576 --ip 192.168.76.2 --volume docker-flags-20211231112605-1576:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b: (2.4107242s)

	I1231 11:33:40.271035    4668 client.go:171] LocalClient.Create took 1m7.67621s

	I1231 11:33:42.283100    4668 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1231 11:33:42.292745    4668 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576

	W1231 11:33:43.798337    4668 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576 returned with exit code 1

	I1231 11:33:43.798337    4668 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576: (1.5055854s)

	I1231 11:33:43.798337    4668 retry.go:31] will retry after 291.140013ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I1231 11:33:44.112354    4668 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576

	W1231 11:33:45.538883    4668 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576 returned with exit code 1

	I1231 11:33:45.538957    4668 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576: (1.4263146s)

	W1231 11:33:45.539038    4668 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W1231 11:33:45.539038    4668 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I1231 11:33:45.539038    4668 start.go:129] duration metric: createHost completed in 1m13.0898763s

	I1231 11:33:45.547520    4668 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1231 11:33:45.554177    4668 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576

	W1231 11:33:47.021358    4668 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576 returned with exit code 1

	I1231 11:33:47.021477    4668 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576: (1.4669699s)

	I1231 11:33:47.021508    4668 retry.go:31] will retry after 231.159374ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I1231 11:33:47.261136    4668 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576

	W1231 11:33:48.748371    4668 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576 returned with exit code 1

	I1231 11:33:48.748700    4668 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-20211231112605-1576: (1.4872284s)

	W1231 11:33:48.748851    4668 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W1231 11:33:48.748851    4668 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I1231 11:33:48.748851    4668 fix.go:57] fixHost completed within 6m8.0404311s

	I1231 11:33:48.748959    4668 start.go:80] releasing machines lock for "docker-flags-20211231112605-1576", held for 6m8.040845s

	W1231 11:33:48.749588    4668 out.go:241] * Failed to start docker container. Running "minikube delete -p docker-flags-20211231112605-1576" may fix it: recreate: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname docker-flags-20211231112605-1576 --name docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --network docker-flags-20211231112605-1576 --ip 192.168.76.2 --volume docker-flags-20211231112605-1576:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::

32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b: exit status 125

	stdout:

	d6a5280d4fcc2d28258b01c2b359b8081cdf3380e947f8fdf8b4aa8b43b66c8f

	stderr:

	docker: Error response from daemon: network docker-flags-20211231112605-1576 not found.

	* Failed to start docker container. Running "minikube delete -p docker-flags-20211231112605-1576" may fix it: recreate: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname docker-flags-20211231112605-1576 --name docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --network docker-flags-20211231112605-1576 --ip 192.168.76.2 --volume docker-flags-20211231112605-1576:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v

0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b: exit status 125

	stdout:

	d6a5280d4fcc2d28258b01c2b359b8081cdf3380e947f8fdf8b4aa8b43b66c8f

	stderr:

	docker: Error response from daemon: network docker-flags-20211231112605-1576 not found.

	I1231 11:33:48.754320    4668 out.go:176] 

	W1231 11:33:48.754622    4668 out.go:241] X Exiting due to GUEST_PROVISION: Failed to start host: recreate: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname docker-flags-20211231112605-1576 --name docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --network docker-flags-20211231112605-1576 --ip 192.168.76.2 --volume docker-flags-20211231112605-1576:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.28-16402

12998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b: exit status 125

	stdout:

	d6a5280d4fcc2d28258b01c2b359b8081cdf3380e947f8fdf8b4aa8b43b66c8f

	stderr:

	docker: Error response from daemon: network docker-flags-20211231112605-1576 not found.

	X Exiting due to GUEST_PROVISION: Failed to start host: recreate: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname docker-flags-20211231112605-1576 --name docker-flags-20211231112605-1576 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=docker-flags-20211231112605-1576 --network docker-flags-20211231112605-1576 --ip 192.168.76.2 --volume docker-flags-20211231112605-1576:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f

390a0092f488f6a1c30865f571c3b6388f9f56f9b: exit status 125

	stdout:

	d6a5280d4fcc2d28258b01c2b359b8081cdf3380e947f8fdf8b4aa8b43b66c8f

	stderr:

	docker: Error response from daemon: network docker-flags-20211231112605-1576 not found.

	W1231 11:33:48.754730    4668 out.go:241] * 

	* 

	W1231 11:33:48.756325    4668 out.go:241] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1231 11:33:48.758688    4668 out.go:176] 

** /stderr **

docker_test.go:48: failed to start minikube with args: "out/minikube-windows-amd64.exe start -p docker-flags-20211231112605-1576 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker" : exit status 80

docker_test.go:51: (dbg) Run:  out/minikube-windows-amd64.exe -p docker-flags-20211231112605-1576 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:51: (dbg) Non-zero exit: out/minikube-windows-amd64.exe -p docker-flags-20211231112605-1576 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 85 (3.4222837s)

-- stdout --

	* The control plane node "" does not exist.

	  To start a cluster, run: "minikube start -p docker-flags-20211231112605-1576"

-- /stdout --

docker_test.go:53: failed to 'systemctl show docker' inside minikube. args "out/minikube-windows-amd64.exe -p docker-flags-20211231112605-1576 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 85

docker_test.go:58: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control plane node \"\" does not exist.\n  To start a cluster, run: \"minikube start -p docker-flags-20211231112605-1576\"\n"*.

docker_test.go:58: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control plane node \"\" does not exist.\n  To start a cluster, run: \"minikube start -p docker-flags-20211231112605-1576\"\n"*.

docker_test.go:62: (dbg) Run:  out/minikube-windows-amd64.exe -p docker-flags-20211231112605-1576 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

docker_test.go:62: (dbg) Non-zero exit: out/minikube-windows-amd64.exe -p docker-flags-20211231112605-1576 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 85 (3.3647195s)

-- stdout --

	* The control plane node "" does not exist.

	  To start a cluster, run: "minikube start -p docker-flags-20211231112605-1576"

-- /stdout --

docker_test.go:64: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-windows-amd64.exe -p docker-flags-20211231112605-1576 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 85

docker_test.go:68: expected "out/minikube-windows-amd64.exe -p docker-flags-20211231112605-1576 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control plane node \"\" does not exist.\n  To start a cluster, run: \"minikube start -p docker-flags-20211231112605-1576\"\n"

panic.go:642: *** TestDockerFlags FAILED at 2021-12-31 11:33:55.7584864 +0000 GMT m=+6555.141838801

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestDockerFlags]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect docker-flags-20211231112605-1576

helpers_test.go:232: (dbg) Done: docker inspect docker-flags-20211231112605-1576: (1.5602369s)

helpers_test.go:236: (dbg) docker inspect docker-flags-20211231112605-1576:

-- stdout --

	[

	    {

	        "Id": "d6a5280d4fcc2d28258b01c2b359b8081cdf3380e947f8fdf8b4aa8b43b66c8f",

	        "Created": "2021-12-31T11:33:39.3605812Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "created",

	            "Running": false,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 0,

	            "ExitCode": 128,

	            "Error": "network docker-flags-20211231112605-1576 not found",

	            "StartedAt": "0001-01-01T00:00:00Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:64d09634c60d2a75596bc705aa84bdc41f76fe47c5d9ee362550bffbdc256979",

	        "ResolvConfPath": "",

	        "HostnamePath": "",

	        "HostsPath": "",

	        "LogPath": "",

	        "Name": "/docker-flags-20211231112605-1576",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "unconfined",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "docker-flags-20211231112605-1576:/var",

	                "/lib/modules:/lib/modules:ro"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "docker-flags-20211231112605-1576",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2147483648,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                {

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

	                }

	            ],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 2147483648,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/cdffe8d5f008ea7badfd0424ee8366eca5d4f480f5103149cd2e369d7942dddb-init/diff:/var/lib/docker/overlay2/236e34868c6bd5ecc10a009188d3dd414c10322ed61f0f8bd2f0cc6afe31d4a2/diff:/var/lib/docker/overlay2/4f26d83e8780f057af23a45796afe2feeb4c6225d04f3e75d86d76ce33e6eeb7/diff:/var/lib/docker/overlay2/1aa2f7df6f61654ba127b3d7ca8e4c7c9faa9ea133a905aee86c5c729b50580e/diff:/var/lib/docker/overlay2/810f58a572d447e357f0e37fcb6e434743ec2c41f1a828b80ea35481ad056b01/diff:/var/lib/docker/overlay2/0f8aaf037fa7c7675cf275f7d2ec3ea76e658acf5a3dab8397689e8f0f123d26/diff:/var/lib/docker/overlay2/be7ae9f76a1638260aab5f1fa7ff3040af697c9a44380f0cc9d6b9f8e13fc3d0/diff:/var/lib/docker/overlay2/ef02c9f68049a2b4bbb3c853a879f858f696367e0e4a0cd3c8f8a560cf64f559/diff:/var/lib/docker/overlay2/35131ade500d28bbea06e314019475aaefc896faf010312fe4a992789b633265/diff:/var/lib/docker/overlay2/8d9649b172e37864a9f036c4de74b67ea5b01978cffc6a9362049d5ea5d6f55d/diff:/var/lib/docker/overlay2/52868f

77169cdf9bc78bcde8ac7ec95f1a8185a6302edb584dbf9a6360daf03a/diff:/var/lib/docker/overlay2/f8c18464f7aef662c8d4ad84d2451d43835e5f4569a4d2b9f30ad97322903d11/diff:/var/lib/docker/overlay2/0101fb0a80bf47a589e85bb95fd060770df32c7a11dbd8a7dcfef4d9d01f8af2/diff:/var/lib/docker/overlay2/07d0477dc6604496cacf7ed9c358a06fe7d29546c33411fecdaf0ecaa2a9a0ef/diff:/var/lib/docker/overlay2/3f31c6e0e5aac9e858d82dd03ebea66448458f5a927add3f654a304d2c37e502/diff:/var/lib/docker/overlay2/d7ed3b53a0a390071295a19edc1e7d6c00a99dfe061348b28a62f8b9a82318d0/diff:/var/lib/docker/overlay2/3b636a10aa41811f93fe647f4a2254548b80bdeb098c8533b22c4d79d53fcdf0/diff:/var/lib/docker/overlay2/ce837cfcf557adff25b0b4b5f4d6f01e0cf5a1b8bb23ee431d224975cacbe2b0/diff:/var/lib/docker/overlay2/3605fc7a2584009be0a2860c72bef0b598b9bc1f266a398074b7c8a7123333b1/diff:/var/lib/docker/overlay2/05a27701432d46329015577bf385d007c4190625712f8101bb39d9a5744fae1b/diff:/var/lib/docker/overlay2/c25e37734ac3910f77446ef67a386f29de76d35b911b15e745ab7622def0e089/diff:/var/lib/d

ocker/overlay2/a8e782b00e5454fb7d4ededfc9896090aac72e1b0b4c00e43cc9e0bdcf4d2906/diff:/var/lib/docker/overlay2/44c82f3c0e578428d3d9bd874ec44bdd533b0d6845072a4aac19be4720565273/diff:/var/lib/docker/overlay2/14d59fa1343c7e69048f262f4f3f304832c41b33f9f6b5d17a01d67b6c488996/diff:/var/lib/docker/overlay2/15c980de9f5f13135282866b74e142b0c02c48a68d5b570fdb352734d154c43c/diff:/var/lib/docker/overlay2/82368a0688767ffd3b7eb2fd7f8cf27704e4ae4f7ecbb8b8b73f437e928c0db7/diff:/var/lib/docker/overlay2/e976758fe64d0a07d050f840cfff6da24646e500eb0758ad525eec4402c332fb/diff:/var/lib/docker/overlay2/74148e6df6795f39b3025653e1114d8d16999f340f4ace621d5d37e82a3698fe/diff:/var/lib/docker/overlay2/05e29b3eb2babc45b9101583a4b8dc9c219237c4297f0678b648a934cd2cf604/diff:/var/lib/docker/overlay2/d7cae5db557577bece8070136b11e87052bce1263acb0b687e90567746b09f61/diff:/var/lib/docker/overlay2/5b1ff4405c06a77b96c7b61fbf1df81004551144d651ae61b632dfc3b269bc76/diff:/var/lib/docker/overlay2/f50ff6635032640d426a42ecb016d73fdb96ba15505a1ae4f01d7cb3315

925fb/diff:/var/lib/docker/overlay2/72f65c380012ae92d0675a1b93218ad4ecd8addccb3371324d814fa248daed27/diff:/var/lib/docker/overlay2/b1c4ea370005cb0ea474c83801a0ba4b376d83bfe171b465e61eeab9fbd46b68/diff:/var/lib/docker/overlay2/182b2273f71a8695b8a041e54bb701488b71028091c701a3271bdf6fd0f2c5f5/diff:/var/lib/docker/overlay2/31812fd31cbde39dd1044b048c3f74540d47fbb1dd15634a350ede4f6725dea5/diff:/var/lib/docker/overlay2/58541d8dc75e6a2ece804245b92e88e76345bdbbdda996fbd757eb2290e3e609/diff:/var/lib/docker/overlay2/207a2c171a9595e78850f4fe19c5e78e337c2201f45a4cebc01f869ca7eecf54/diff:/var/lib/docker/overlay2/93569597c37885046de0762af7ba9d6379d54b5533be30cc27f514859f28f7ba/diff:/var/lib/docker/overlay2/57f04579d4692224f2cabd08068218468a37e48174920084405ce9ae88d5d7a7/diff:/var/lib/docker/overlay2/db96b3bbab3bd95dcee0936a5ab318b82dcc941cc09c1fd201e21d97dd5d7617/diff:/var/lib/docker/overlay2/0560b92e88427b3710f730d81a8d910fa8c7feee2a4273c4abb5c51364213d07/diff:/var/lib/docker/overlay2/4e3f380bd40064fcfb56a83f831a38ef53e4ea

bbf36f7661d063e55ccf2972c0/diff:/var/lib/docker/overlay2/65534d10a48ed16cb8b24cc817d40ad1c80c0bbb261a2b966fb4e1bac0f2b524/diff:/var/lib/docker/overlay2/799e74a4ab0cf4fb970c0d6f14af7e37410bf1168fcb40d81c85c773f406f235/diff",

	                "MergedDir": "/var/lib/docker/overlay2/cdffe8d5f008ea7badfd0424ee8366eca5d4f480f5103149cd2e369d7942dddb/merged",

	                "UpperDir": "/var/lib/docker/overlay2/cdffe8d5f008ea7badfd0424ee8366eca5d4f480f5103149cd2e369d7942dddb/diff",

	                "WorkDir": "/var/lib/docker/overlay2/cdffe8d5f008ea7badfd0424ee8366eca5d4f480f5103149cd2e369d7942dddb/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "volume",

	                "Name": "docker-flags-20211231112605-1576",

	                "Source": "/var/lib/docker/volumes/docker-flags-20211231112605-1576/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "docker-flags-20211231112605-1576",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "docker-flags-20211231112605-1576",

	                "name.minikube.sigs.k8s.io": "docker-flags-20211231112605-1576",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {},

	            "SandboxKey": "",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "docker-flags-20211231112605-1576": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.76.2"

	                    },

	                    "Links": null,

	                    "Aliases": null,

	                    "NetworkID": "",

	                    "EndpointID": "",

	                    "Gateway": "",

	                    "IPAddress": "",

	                    "IPPrefixLen": 0,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p docker-flags-20211231112605-1576 -n docker-flags-20211231112605-1576

=== CONT  TestDockerFlags

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.Host}} -p docker-flags-20211231112605-1576 -n docker-flags-20211231112605-1576: exit status 7 (3.6572009s)

-- stdout --

	Nonexistent

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "docker-flags-20211231112605-1576" host is not running, skipping log retrieval (state="Nonexistent")

helpers_test.go:176: Cleaning up "docker-flags-20211231112605-1576" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-windows-amd64.exe delete -p docker-flags-20211231112605-1576

E1231 11:34:17.065466    1576 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\functional-20211231100252-1576\client.crt: The system cannot find the path specified.

helpers_test.go:179: (dbg) Done: out/minikube-windows-amd64.exe delete -p docker-flags-20211231112605-1576: (29.0367071s)

--- FAIL: TestDockerFlags (504.90s)

=== RUN   TestFunctional/parallel/DryRun

=== PAUSE TestFunctional/parallel/DryRun

=== CONT  TestFunctional/parallel/DryRun

functional_test.go:957: (dbg) Run:  out/minikube-windows-amd64.exe start -p functional-20211231100252-1576 --dry-run --memory 250MB --alsologtostderr --driver=docker

=== CONT  TestFunctional/parallel/DryRun

functional_test.go:957: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p functional-20211231100252-1576 --dry-run --memory 250MB --alsologtostderr --driver=docker: exit status 1 (5.0123096s)

-- stdout --

	* [functional-20211231100252-1576] minikube v1.24.0 on Microsoft Windows 10 Enterprise N 10.0.18363 Build 18363

	  - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	  - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	  - MINIKUBE_LOCATION=12739

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

-- /stdout --

** stderr ** 

	I1231 10:09:07.167088    3776 out.go:297] Setting OutFile to fd 776 ...

	I1231 10:09:07.225708    3776 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 10:09:07.225708    3776 out.go:310] Setting ErrFile to fd 1004...

	I1231 10:09:07.225708    3776 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 10:09:07.236627    3776 out.go:304] Setting JSON to false

	I1231 10:09:07.239001    3776 start.go:112] hostinfo: {"hostname":"minikube7","uptime":31787,"bootTime":1640913560,"procs":154,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.18363 Build 18363","kernelVersion":"10.0.18363 Build 18363","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f66ed2ea-6c04-4a6b-8eea-b2fb0953e990"}

	W1231 10:09:07.239001    3776 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1231 10:09:07.243001    3776 out.go:176] * [functional-20211231100252-1576] minikube v1.24.0 on Microsoft Windows 10 Enterprise N 10.0.18363 Build 18363

	I1231 10:09:07.247003    3776 out.go:176]   - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 10:09:07.250006    3776 out.go:176]   - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	I1231 10:09:07.252003    3776 out.go:176]   - MINIKUBE_LOCATION=12739

	I1231 10:09:07.253998    3776 out.go:176]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1231 10:09:07.254999    3776 config.go:176] Loaded profile config "functional-20211231100252-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.1

	I1231 10:09:07.255991    3776 driver.go:344] Setting default libvirt URI to qemu:///system

	I1231 10:09:09.857984    3776 docker.go:132] docker version: linux-20.10.11

	I1231 10:09:09.867466    3776 cli_runner.go:133] Run: docker system info --format "{{json .}}"

** /stderr **

functional_test.go:965: dry-run(250MB) exit code = 1, wanted = 23: exit status 1

functional_test.go:974: (dbg) Run:  out/minikube-windows-amd64.exe start -p functional-20211231100252-1576 --dry-run --alsologtostderr -v=1 --driver=docker

=== CONT  TestFunctional/parallel/DryRun

functional_test.go:974: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p functional-20211231100252-1576 --dry-run --alsologtostderr -v=1 --driver=docker: exit status 1 (5.0206823s)

-- stdout --

	* [functional-20211231100252-1576] minikube v1.24.0 on Microsoft Windows 10 Enterprise N 10.0.18363 Build 18363

	  - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	  - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	  - MINIKUBE_LOCATION=12739

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

-- /stdout --

** stderr ** 

	I1231 10:09:12.194790    7888 out.go:297] Setting OutFile to fd 752 ...

	I1231 10:09:12.267907    7888 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 10:09:12.267907    7888 out.go:310] Setting ErrFile to fd 688...

	I1231 10:09:12.267907    7888 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 10:09:12.276908    7888 out.go:304] Setting JSON to false

	I1231 10:09:12.278903    7888 start.go:112] hostinfo: {"hostname":"minikube7","uptime":31792,"bootTime":1640913560,"procs":152,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.18363 Build 18363","kernelVersion":"10.0.18363 Build 18363","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f66ed2ea-6c04-4a6b-8eea-b2fb0953e990"}

	W1231 10:09:12.278903    7888 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1231 10:09:12.294478    7888 out.go:176] * [functional-20211231100252-1576] minikube v1.24.0 on Microsoft Windows 10 Enterprise N 10.0.18363 Build 18363

	I1231 10:09:12.298222    7888 out.go:176]   - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 10:09:12.300642    7888 out.go:176]   - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	I1231 10:09:12.302761    7888 out.go:176]   - MINIKUBE_LOCATION=12739

	I1231 10:09:12.304815    7888 out.go:176]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1231 10:09:12.305785    7888 config.go:176] Loaded profile config "functional-20211231100252-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.1

	I1231 10:09:12.306780    7888 driver.go:344] Setting default libvirt URI to qemu:///system

	I1231 10:09:14.957094    7888 docker.go:132] docker version: linux-20.10.11

	I1231 10:09:14.962090    7888 cli_runner.go:133] Run: docker system info --format "{{json .}}"

** /stderr **

functional_test.go:980: dry-run exit code = 1, wanted = 0: exit status 1

--- FAIL: TestFunctional/parallel/DryRun (10.03s)

=== RUN   TestFunctional/parallel/InternationalLanguage

=== PAUSE TestFunctional/parallel/InternationalLanguage

=== CONT  TestFunctional/parallel/InternationalLanguage

=== CONT  TestFunctional/parallel/InternationalLanguage

functional_test.go:999: (dbg) Run:  out/minikube-windows-amd64.exe start -p functional-20211231100252-1576 --dry-run --memory 250MB --alsologtostderr --driver=docker

=== CONT  TestFunctional/parallel/InternationalLanguage

functional_test.go:999: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p functional-20211231100252-1576 --dry-run --memory 250MB --alsologtostderr --driver=docker: exit status 1 (5.0207838s)

-- stdout --

	* [functional-20211231100252-1576] minikube v1.24.0 sur Microsoft Windows 10 Enterprise N 10.0.18363 Build 18363

	  - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	  - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	  - MINIKUBE_LOCATION=12739

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

-- /stdout --

** stderr ** 

	I1231 10:09:05.405461    6280 out.go:297] Setting OutFile to fd 788 ...

	I1231 10:09:05.500469    6280 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 10:09:05.501463    6280 out.go:310] Setting ErrFile to fd 752...

	I1231 10:09:05.501463    6280 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 10:09:05.513463    6280 out.go:304] Setting JSON to false

	I1231 10:09:05.515479    6280 start.go:112] hostinfo: {"hostname":"minikube7","uptime":31786,"bootTime":1640913559,"procs":148,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.18363 Build 18363","kernelVersion":"10.0.18363 Build 18363","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f66ed2ea-6c04-4a6b-8eea-b2fb0953e990"}

	W1231 10:09:05.515479    6280 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1231 10:09:05.519467    6280 out.go:176] * [functional-20211231100252-1576] minikube v1.24.0 sur Microsoft Windows 10 Enterprise N 10.0.18363 Build 18363

	I1231 10:09:05.522466    6280 out.go:176]   - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 10:09:05.526467    6280 out.go:176]   - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	I1231 10:09:05.529470    6280 out.go:176]   - MINIKUBE_LOCATION=12739

	I1231 10:09:05.531466    6280 out.go:176]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1231 10:09:05.532479    6280 config.go:176] Loaded profile config "functional-20211231100252-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.1

	I1231 10:09:05.533461    6280 driver.go:344] Setting default libvirt URI to qemu:///system

	I1231 10:09:08.142217    6280 docker.go:132] docker version: linux-20.10.11

	I1231 10:09:08.148217    6280 cli_runner.go:133] Run: docker system info --format "{{json .}}"

** /stderr **

functional_test.go:1006: dry-run(250MB) exit code = 1, wanted = 23: exit status 1

functional_test.go:1011: dry-run output was expected to be in French. Expected "Utilisation du pilote", but not present in output:

* [functional-20211231100252-1576] minikube v1.24.0 sur Microsoft Windows 10 Enterprise N 10.0.18363 Build 18363

- KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

- MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

- MINIKUBE_LOCATION=12739

- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

--- FAIL: TestFunctional/parallel/InternationalLanguage (5.02s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

E1231 10:10:30.400373    1576 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\addons-20211231094703-1576\client.crt: The system cannot find the path specified.

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Done: kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}: (1.3581151s)

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Done: kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}: (1.829292s)

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:180: nginx-svc svc.status.loadBalancer.ingress never got an IP: timed out waiting for the condition

functional_test_tunnel_test.go:181: (dbg) Run:  kubectl --context functional-20211231100252-1576 get svc nginx-svc

functional_test_tunnel_test.go:185: failed to kubectl get svc nginx-svc:

-- stdout --

	NAME        TYPE           CLUSTER-IP      EXTERNAL-IP   PORT(S)        AGE

	nginx-svc   LoadBalancer   10.106.12.206   <pending>     80:30037/TCP   3m22s

-- /stdout --

--- FAIL: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (180.59s)

=== RUN   TestNoKubernetes/serial/StartWithStopK8s

no_kubernetes_test.go:113: (dbg) Run:  out/minikube-windows-amd64.exe start -p NoKubernetes-20211231111352-1576 --no-kubernetes --driver=docker

=== CONT  TestNoKubernetes/serial/StartWithStopK8s

no_kubernetes_test.go:113: (dbg) Done: out/minikube-windows-amd64.exe start -p NoKubernetes-20211231111352-1576 --no-kubernetes --driver=docker: (48.9087976s)

no_kubernetes_test.go:201: (dbg) Run:  out/minikube-windows-amd64.exe -p NoKubernetes-20211231111352-1576 status -o json

E1231 11:18:29.787865    1576 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\ingress-addon-legacy-20211231101440-1576\client.crt: The system cannot find the path specified.

no_kubernetes_test.go:201: (dbg) Non-zero exit: out/minikube-windows-amd64.exe -p NoKubernetes-20211231111352-1576 status -o json: exit status 2 (8.0599309s)

-- stdout --

	{"Name":"NoKubernetes-20211231111352-1576","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

-- /stdout --

no_kubernetes_test.go:125: (dbg) Run:  out/minikube-windows-amd64.exe delete -p NoKubernetes-20211231111352-1576

E1231 11:18:49.210654    1576 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\skaffold-20211231110743-1576\client.crt: The system cannot find the path specified.

no_kubernetes_test.go:125: (dbg) Non-zero exit: out/minikube-windows-amd64.exe delete -p NoKubernetes-20211231111352-1576: exit status 1 (21.5410753s)

-- stdout --

	* Deleting "NoKubernetes-20211231111352-1576" in docker ...

	* Deleting container "NoKubernetes-20211231111352-1576" ...

-- /stdout --

no_kubernetes_test.go:127: failed to delete minikube profile with args: "out/minikube-windows-amd64.exe delete -p NoKubernetes-20211231111352-1576" : exit status 1

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestNoKubernetes/serial/StartWithStopK8s]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect NoKubernetes-20211231111352-1576

helpers_test.go:232: (dbg) Done: docker inspect NoKubernetes-20211231111352-1576: (1.5309076s)

helpers_test.go:236: (dbg) docker inspect NoKubernetes-20211231111352-1576:

-- stdout --

	[

	    {

	        "Id": "0149e6ef93f3e63c9a1d9d5b406d7f8be97270de2495e5b46384497176f8f675",

	        "Created": "2021-12-31T11:15:49.0597011Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "exited",

	            "Running": false,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 0,

	            "ExitCode": 130,

	            "Error": "",

	            "StartedAt": "2021-12-31T11:15:53.6794381Z",

	            "FinishedAt": "2021-12-31T11:18:39.6060673Z"

	        },

	        "Image": "sha256:64d09634c60d2a75596bc705aa84bdc41f76fe47c5d9ee362550bffbdc256979",

	        "ResolvConfPath": "/var/lib/docker/containers/0149e6ef93f3e63c9a1d9d5b406d7f8be97270de2495e5b46384497176f8f675/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/0149e6ef93f3e63c9a1d9d5b406d7f8be97270de2495e5b46384497176f8f675/hostname",

	        "HostsPath": "/var/lib/docker/containers/0149e6ef93f3e63c9a1d9d5b406d7f8be97270de2495e5b46384497176f8f675/hosts",

	        "LogPath": "/var/lib/docker/containers/0149e6ef93f3e63c9a1d9d5b406d7f8be97270de2495e5b46384497176f8f675/0149e6ef93f3e63c9a1d9d5b406d7f8be97270de2495e5b46384497176f8f675-json.log",

	        "Name": "/NoKubernetes-20211231111352-1576",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "NoKubernetes-20211231111352-1576:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "NoKubernetes-20211231111352-1576",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 17091788800,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                {

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

	                }

	            ],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 17091788800,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/3b40924dd2d07b29ece0775f1f05a68f51e737cec71d094c2f2c954769171ba5-init/diff:/var/lib/docker/overlay2/236e34868c6bd5ecc10a009188d3dd414c10322ed61f0f8bd2f0cc6afe31d4a2/diff:/var/lib/docker/overlay2/4f26d83e8780f057af23a45796afe2feeb4c6225d04f3e75d86d76ce33e6eeb7/diff:/var/lib/docker/overlay2/1aa2f7df6f61654ba127b3d7ca8e4c7c9faa9ea133a905aee86c5c729b50580e/diff:/var/lib/docker/overlay2/810f58a572d447e357f0e37fcb6e434743ec2c41f1a828b80ea35481ad056b01/diff:/var/lib/docker/overlay2/0f8aaf037fa7c7675cf275f7d2ec3ea76e658acf5a3dab8397689e8f0f123d26/diff:/var/lib/docker/overlay2/be7ae9f76a1638260aab5f1fa7ff3040af697c9a44380f0cc9d6b9f8e13fc3d0/diff:/var/lib/docker/overlay2/ef02c9f68049a2b4bbb3c853a879f858f696367e0e4a0cd3c8f8a560cf64f559/diff:/var/lib/docker/overlay2/35131ade500d28bbea06e314019475aaefc896faf010312fe4a992789b633265/diff:/var/lib/docker/overlay2/8d9649b172e37864a9f036c4de74b67ea5b01978cffc6a9362049d5ea5d6f55d/diff:/var/lib/docker/overlay2/52868f

77169cdf9bc78bcde8ac7ec95f1a8185a6302edb584dbf9a6360daf03a/diff:/var/lib/docker/overlay2/f8c18464f7aef662c8d4ad84d2451d43835e5f4569a4d2b9f30ad97322903d11/diff:/var/lib/docker/overlay2/0101fb0a80bf47a589e85bb95fd060770df32c7a11dbd8a7dcfef4d9d01f8af2/diff:/var/lib/docker/overlay2/07d0477dc6604496cacf7ed9c358a06fe7d29546c33411fecdaf0ecaa2a9a0ef/diff:/var/lib/docker/overlay2/3f31c6e0e5aac9e858d82dd03ebea66448458f5a927add3f654a304d2c37e502/diff:/var/lib/docker/overlay2/d7ed3b53a0a390071295a19edc1e7d6c00a99dfe061348b28a62f8b9a82318d0/diff:/var/lib/docker/overlay2/3b636a10aa41811f93fe647f4a2254548b80bdeb098c8533b22c4d79d53fcdf0/diff:/var/lib/docker/overlay2/ce837cfcf557adff25b0b4b5f4d6f01e0cf5a1b8bb23ee431d224975cacbe2b0/diff:/var/lib/docker/overlay2/3605fc7a2584009be0a2860c72bef0b598b9bc1f266a398074b7c8a7123333b1/diff:/var/lib/docker/overlay2/05a27701432d46329015577bf385d007c4190625712f8101bb39d9a5744fae1b/diff:/var/lib/docker/overlay2/c25e37734ac3910f77446ef67a386f29de76d35b911b15e745ab7622def0e089/diff:/var/lib/d

ocker/overlay2/a8e782b00e5454fb7d4ededfc9896090aac72e1b0b4c00e43cc9e0bdcf4d2906/diff:/var/lib/docker/overlay2/44c82f3c0e578428d3d9bd874ec44bdd533b0d6845072a4aac19be4720565273/diff:/var/lib/docker/overlay2/14d59fa1343c7e69048f262f4f3f304832c41b33f9f6b5d17a01d67b6c488996/diff:/var/lib/docker/overlay2/15c980de9f5f13135282866b74e142b0c02c48a68d5b570fdb352734d154c43c/diff:/var/lib/docker/overlay2/82368a0688767ffd3b7eb2fd7f8cf27704e4ae4f7ecbb8b8b73f437e928c0db7/diff:/var/lib/docker/overlay2/e976758fe64d0a07d050f840cfff6da24646e500eb0758ad525eec4402c332fb/diff:/var/lib/docker/overlay2/74148e6df6795f39b3025653e1114d8d16999f340f4ace621d5d37e82a3698fe/diff:/var/lib/docker/overlay2/05e29b3eb2babc45b9101583a4b8dc9c219237c4297f0678b648a934cd2cf604/diff:/var/lib/docker/overlay2/d7cae5db557577bece8070136b11e87052bce1263acb0b687e90567746b09f61/diff:/var/lib/docker/overlay2/5b1ff4405c06a77b96c7b61fbf1df81004551144d651ae61b632dfc3b269bc76/diff:/var/lib/docker/overlay2/f50ff6635032640d426a42ecb016d73fdb96ba15505a1ae4f01d7cb3315

925fb/diff:/var/lib/docker/overlay2/72f65c380012ae92d0675a1b93218ad4ecd8addccb3371324d814fa248daed27/diff:/var/lib/docker/overlay2/b1c4ea370005cb0ea474c83801a0ba4b376d83bfe171b465e61eeab9fbd46b68/diff:/var/lib/docker/overlay2/182b2273f71a8695b8a041e54bb701488b71028091c701a3271bdf6fd0f2c5f5/diff:/var/lib/docker/overlay2/31812fd31cbde39dd1044b048c3f74540d47fbb1dd15634a350ede4f6725dea5/diff:/var/lib/docker/overlay2/58541d8dc75e6a2ece804245b92e88e76345bdbbdda996fbd757eb2290e3e609/diff:/var/lib/docker/overlay2/207a2c171a9595e78850f4fe19c5e78e337c2201f45a4cebc01f869ca7eecf54/diff:/var/lib/docker/overlay2/93569597c37885046de0762af7ba9d6379d54b5533be30cc27f514859f28f7ba/diff:/var/lib/docker/overlay2/57f04579d4692224f2cabd08068218468a37e48174920084405ce9ae88d5d7a7/diff:/var/lib/docker/overlay2/db96b3bbab3bd95dcee0936a5ab318b82dcc941cc09c1fd201e21d97dd5d7617/diff:/var/lib/docker/overlay2/0560b92e88427b3710f730d81a8d910fa8c7feee2a4273c4abb5c51364213d07/diff:/var/lib/docker/overlay2/4e3f380bd40064fcfb56a83f831a38ef53e4ea

bbf36f7661d063e55ccf2972c0/diff:/var/lib/docker/overlay2/65534d10a48ed16cb8b24cc817d40ad1c80c0bbb261a2b966fb4e1bac0f2b524/diff:/var/lib/docker/overlay2/799e74a4ab0cf4fb970c0d6f14af7e37410bf1168fcb40d81c85c773f406f235/diff",

	                "MergedDir": "/var/lib/docker/overlay2/3b40924dd2d07b29ece0775f1f05a68f51e737cec71d094c2f2c954769171ba5/merged",

	                "UpperDir": "/var/lib/docker/overlay2/3b40924dd2d07b29ece0775f1f05a68f51e737cec71d094c2f2c954769171ba5/diff",

	                "WorkDir": "/var/lib/docker/overlay2/3b40924dd2d07b29ece0775f1f05a68f51e737cec71d094c2f2c954769171ba5/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "NoKubernetes-20211231111352-1576",

	                "Source": "/var/lib/docker/volumes/NoKubernetes-20211231111352-1576/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "NoKubernetes-20211231111352-1576",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "NoKubernetes-20211231111352-1576",

	                "name.minikube.sigs.k8s.io": "NoKubernetes-20211231111352-1576",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "4addfebabb607527f33117705835b2dc84d8e0cee90496c44f1a7c6a8f607aeb",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {},

	            "SandboxKey": "/var/run/docker/netns/4addfebabb60",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "NoKubernetes-20211231111352-1576": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.58.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "0149e6ef93f3",

	                        "NoKubernetes-20211231111352-1576"

	                    ],

	                    "NetworkID": "f05668cf14b3694680f0398b48b1b453152f265d1f5aa711a638c118be4750b0",

	                    "EndpointID": "",

	                    "Gateway": "",

	                    "IPAddress": "",

	                    "IPPrefixLen": 0,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p NoKubernetes-20211231111352-1576 -n NoKubernetes-20211231111352-1576

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.Host}} -p NoKubernetes-20211231111352-1576 -n NoKubernetes-20211231111352-1576: exit status 7 (3.5278875s)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "NoKubernetes-20211231111352-1576" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestNoKubernetes/serial/StartWithStopK8s (83.58s)

=== RUN   TestPause/serial/PauseAgain

pause_test.go:112: (dbg) Run:  out/minikube-windows-amd64.exe pause -p pause-20211231111903-1576 --alsologtostderr -v=5

pause_test.go:112: (dbg) Non-zero exit: out/minikube-windows-amd64.exe pause -p pause-20211231111903-1576 --alsologtostderr -v=5: exit status 80 (15.7028265s)

-- stdout --

	* Pausing node pause-20211231111903-1576 ... 

-- /stdout --

** stderr ** 

	I1231 11:23:51.665199    8400 out.go:297] Setting OutFile to fd 1652 ...

	I1231 11:23:51.728173    8400 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 11:23:51.728173    8400 out.go:310] Setting ErrFile to fd 1556...

	I1231 11:23:51.728173    8400 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 11:23:51.747202    8400 out.go:304] Setting JSON to false

	I1231 11:23:51.747202    8400 mustload.go:65] Loading cluster: pause-20211231111903-1576

	I1231 11:23:51.749212    8400 config.go:176] Loaded profile config "pause-20211231111903-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.1

	I1231 11:23:51.765198    8400 cli_runner.go:133] Run: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}

	I1231 11:23:54.759306    8400 cli_runner.go:186] Completed: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}: (2.9939394s)

	I1231 11:23:54.759377    8400 host.go:66] Checking if "pause-20211231111903-1576" exists ...

	I1231 11:23:54.769969    8400 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:56.150697    8400 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.3807226s)

	I1231 11:23:56.151713    8400 pause.go:58] "namespaces" [kube-system kubernetes-dashboard storage-gluster istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cert-expiration:26280h0m0s cni: container-runtime:docker cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false)

host-dns-resolver:%!s(bool=true) host-only-cidr:192.168.59.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/13195/minikube-v1.24.0-1640253061-13195.iso https://github.com/kubernetes/minikube/releases/download/v1.24.0-1640253061-13195/minikube-v1.24.0-1640253061-13195.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.24.0-1640253061-13195.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qemu-uri:qemu:///system listen-address: memory: mount:%!s(bool=false) mount-9p-version:9p2000.L mount-gid:docker mount-ip: mount-msize:%!s(int=262144) mount-options:[] m

ount-port:0 mount-string:C:\Users\jenkins.minikube7:/minikube-host mount-type:9p mount-uid:docker namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plugin: nfs-share:[] nfs-shares-root:/nfsshares no-kubernetes:%!s(bool=false) no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:pause-20211231111903-1576 purge:%!s(bool=false) registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) schedule:0s service-cluster-ip-range:10.96.0.0/12 ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true) wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"

	I1231 11:23:56.334011    8400 out.go:176] * Pausing node pause-20211231111903-1576 ... 

	I1231 11:23:56.334519    8400 host.go:66] Checking if "pause-20211231111903-1576" exists ...

	I1231 11:23:56.346020    8400 ssh_runner.go:195] Run: systemctl --version

	I1231 11:23:56.352435    8400 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:57.686482    8400 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.3331518s)

	I1231 11:23:57.687006    8400 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:23:57.827556    8400 ssh_runner.go:235] Completed: systemctl --version: (1.4814541s)

	I1231 11:23:57.835555    8400 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1231 11:23:57.863759    8400 pause.go:50] kubelet running: true

	I1231 11:23:57.875019    8400 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I1231 11:23:58.325552    8400 ssh_runner.go:195] Run: docker ps --filter status=running --filter=name=k8s_.*_(kube-system|kubernetes-dashboard|storage-gluster|istio-operator)_ --format={{.ID}}

	I1231 11:23:58.406323    8400 docker.go:430] Pausing containers: [f058545bad9d 170e6b6065b2 74a4e3d88a70 8fa6dc58558e df30f3b8d297 d320cc67dbfe 0312af21019e 59516730c193 0cc844e63a7c 0843676a5aa7 101beefb89f1 2b8f428d720b 50cfe963fa30 62f3e2013ffe]

	I1231 11:23:58.412316    8400 ssh_runner.go:195] Run: docker pause f058545bad9d 170e6b6065b2 74a4e3d88a70 8fa6dc58558e df30f3b8d297 d320cc67dbfe 0312af21019e 59516730c193 0cc844e63a7c 0843676a5aa7 101beefb89f1 2b8f428d720b 50cfe963fa30 62f3e2013ffe

	I1231 11:24:07.067256    8400 ssh_runner.go:235] Completed: docker pause f058545bad9d 170e6b6065b2 74a4e3d88a70 8fa6dc58558e df30f3b8d297 d320cc67dbfe 0312af21019e 59516730c193 0cc844e63a7c 0843676a5aa7 101beefb89f1 2b8f428d720b 50cfe963fa30 62f3e2013ffe: (8.6549037s)

	I1231 11:24:07.071721    8400 out.go:176] 

	W1231 11:24:07.071721    8400 out.go:241] X Exiting due to GUEST_PAUSE: docker: docker pause f058545bad9d 170e6b6065b2 74a4e3d88a70 8fa6dc58558e df30f3b8d297 d320cc67dbfe 0312af21019e 59516730c193 0cc844e63a7c 0843676a5aa7 101beefb89f1 2b8f428d720b 50cfe963fa30 62f3e2013ffe: Process exited with status 1

	stdout:

	170e6b6065b2

	74a4e3d88a70

	8fa6dc58558e

	df30f3b8d297

	d320cc67dbfe

	0312af21019e

	59516730c193

	0cc844e63a7c

	101beefb89f1

	2b8f428d720b

	50cfe963fa30

	62f3e2013ffe

	stderr:

	Error response from daemon: Container f058545bad9de7df5c68cd5cf5aba8846942577907b1f229f21e7676a8736b2e is not running

	Error response from daemon: Cannot pause container 0843676a5aa7b1cbebd6a16a57ca6a1278c3da65fd3a4b46465cc4df734482ac: OCI runtime pause failed: unable to freeze: unknown

	X Exiting due to GUEST_PAUSE: docker: docker pause f058545bad9d 170e6b6065b2 74a4e3d88a70 8fa6dc58558e df30f3b8d297 d320cc67dbfe 0312af21019e 59516730c193 0cc844e63a7c 0843676a5aa7 101beefb89f1 2b8f428d720b 50cfe963fa30 62f3e2013ffe: Process exited with status 1

	stdout:

	170e6b6065b2

	74a4e3d88a70

	8fa6dc58558e

	df30f3b8d297

	d320cc67dbfe

	0312af21019e

	59516730c193

	0cc844e63a7c

	101beefb89f1

	2b8f428d720b

	50cfe963fa30

	62f3e2013ffe

	stderr:

	Error response from daemon: Container f058545bad9de7df5c68cd5cf5aba8846942577907b1f229f21e7676a8736b2e is not running

	Error response from daemon: Cannot pause container 0843676a5aa7b1cbebd6a16a57ca6a1278c3da65fd3a4b46465cc4df734482ac: OCI runtime pause failed: unable to freeze: unknown

	W1231 11:24:07.071721    8400 out.go:241] * 

	* 

	W1231 11:24:07.122420    8400 out.go:241] ╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                        │

	│    * If the above advice does not help, please let us know:                                                            │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                          │

	│                                                                                                                        │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                               │

	│    * Please also attach the following file to the GitHub issue:                                                        │

	│    * - C:\Users\jenkins.minikube7\AppData\Local\Temp\minikube_pause_8a34b101973a5475dd3f2895f630b939c2202307_10.log    │

	│                                                                                                                        │

	╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                        │

	│    * If the above advice does not help, please let us know:                                                            │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                          │

	│                                                                                                                        │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                               │

	│    * Please also attach the following file to the GitHub issue:                                                        │

	│    * - C:\Users\jenkins.minikube7\AppData\Local\Temp\minikube_pause_8a34b101973a5475dd3f2895f630b939c2202307_10.log    │

	│                                                                                                                        │

	╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I1231 11:24:07.128425    8400 out.go:176] 

** /stderr **

pause_test.go:114: failed to pause minikube with args: "out/minikube-windows-amd64.exe pause -p pause-20211231111903-1576 --alsologtostderr -v=5" : exit status 80

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestPause/serial/PauseAgain]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect pause-20211231111903-1576

helpers_test.go:232: (dbg) Done: docker inspect pause-20211231111903-1576: (1.4360946s)

helpers_test.go:236: (dbg) docker inspect pause-20211231111903-1576:

-- stdout --

	[

	    {

	        "Id": "1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939",

	        "Created": "2021-12-31T11:20:29.4220091Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 140179,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-12-31T11:20:34.3453303Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:64d09634c60d2a75596bc705aa84bdc41f76fe47c5d9ee362550bffbdc256979",

	        "ResolvConfPath": "/var/lib/docker/containers/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939/hostname",

	        "HostsPath": "/var/lib/docker/containers/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939/hosts",

	        "LogPath": "/var/lib/docker/containers/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939-json.log",

	        "Name": "/pause-20211231111903-1576",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "pause-20211231111903-1576:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "pause-20211231111903-1576",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2147483648,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                {

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

	                }

	            ],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 2147483648,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/6d359abb314d7bfb2a472b74bfae13c89d61fc9fda0da2fdcee73f107d73eda9-init/diff:/var/lib/docker/overlay2/236e34868c6bd5ecc10a009188d3dd414c10322ed61f0f8bd2f0cc6afe31d4a2/diff:/var/lib/docker/overlay2/4f26d83e8780f057af23a45796afe2feeb4c6225d04f3e75d86d76ce33e6eeb7/diff:/var/lib/docker/overlay2/1aa2f7df6f61654ba127b3d7ca8e4c7c9faa9ea133a905aee86c5c729b50580e/diff:/var/lib/docker/overlay2/810f58a572d447e357f0e37fcb6e434743ec2c41f1a828b80ea35481ad056b01/diff:/var/lib/docker/overlay2/0f8aaf037fa7c7675cf275f7d2ec3ea76e658acf5a3dab8397689e8f0f123d26/diff:/var/lib/docker/overlay2/be7ae9f76a1638260aab5f1fa7ff3040af697c9a44380f0cc9d6b9f8e13fc3d0/diff:/var/lib/docker/overlay2/ef02c9f68049a2b4bbb3c853a879f858f696367e0e4a0cd3c8f8a560cf64f559/diff:/var/lib/docker/overlay2/35131ade500d28bbea06e314019475aaefc896faf010312fe4a992789b633265/diff:/var/lib/docker/overlay2/8d9649b172e37864a9f036c4de74b67ea5b01978cffc6a9362049d5ea5d6f55d/diff:/var/lib/docker/overlay2/52868f

77169cdf9bc78bcde8ac7ec95f1a8185a6302edb584dbf9a6360daf03a/diff:/var/lib/docker/overlay2/f8c18464f7aef662c8d4ad84d2451d43835e5f4569a4d2b9f30ad97322903d11/diff:/var/lib/docker/overlay2/0101fb0a80bf47a589e85bb95fd060770df32c7a11dbd8a7dcfef4d9d01f8af2/diff:/var/lib/docker/overlay2/07d0477dc6604496cacf7ed9c358a06fe7d29546c33411fecdaf0ecaa2a9a0ef/diff:/var/lib/docker/overlay2/3f31c6e0e5aac9e858d82dd03ebea66448458f5a927add3f654a304d2c37e502/diff:/var/lib/docker/overlay2/d7ed3b53a0a390071295a19edc1e7d6c00a99dfe061348b28a62f8b9a82318d0/diff:/var/lib/docker/overlay2/3b636a10aa41811f93fe647f4a2254548b80bdeb098c8533b22c4d79d53fcdf0/diff:/var/lib/docker/overlay2/ce837cfcf557adff25b0b4b5f4d6f01e0cf5a1b8bb23ee431d224975cacbe2b0/diff:/var/lib/docker/overlay2/3605fc7a2584009be0a2860c72bef0b598b9bc1f266a398074b7c8a7123333b1/diff:/var/lib/docker/overlay2/05a27701432d46329015577bf385d007c4190625712f8101bb39d9a5744fae1b/diff:/var/lib/docker/overlay2/c25e37734ac3910f77446ef67a386f29de76d35b911b15e745ab7622def0e089/diff:/var/lib/d

ocker/overlay2/a8e782b00e5454fb7d4ededfc9896090aac72e1b0b4c00e43cc9e0bdcf4d2906/diff:/var/lib/docker/overlay2/44c82f3c0e578428d3d9bd874ec44bdd533b0d6845072a4aac19be4720565273/diff:/var/lib/docker/overlay2/14d59fa1343c7e69048f262f4f3f304832c41b33f9f6b5d17a01d67b6c488996/diff:/var/lib/docker/overlay2/15c980de9f5f13135282866b74e142b0c02c48a68d5b570fdb352734d154c43c/diff:/var/lib/docker/overlay2/82368a0688767ffd3b7eb2fd7f8cf27704e4ae4f7ecbb8b8b73f437e928c0db7/diff:/var/lib/docker/overlay2/e976758fe64d0a07d050f840cfff6da24646e500eb0758ad525eec4402c332fb/diff:/var/lib/docker/overlay2/74148e6df6795f39b3025653e1114d8d16999f340f4ace621d5d37e82a3698fe/diff:/var/lib/docker/overlay2/05e29b3eb2babc45b9101583a4b8dc9c219237c4297f0678b648a934cd2cf604/diff:/var/lib/docker/overlay2/d7cae5db557577bece8070136b11e87052bce1263acb0b687e90567746b09f61/diff:/var/lib/docker/overlay2/5b1ff4405c06a77b96c7b61fbf1df81004551144d651ae61b632dfc3b269bc76/diff:/var/lib/docker/overlay2/f50ff6635032640d426a42ecb016d73fdb96ba15505a1ae4f01d7cb3315

925fb/diff:/var/lib/docker/overlay2/72f65c380012ae92d0675a1b93218ad4ecd8addccb3371324d814fa248daed27/diff:/var/lib/docker/overlay2/b1c4ea370005cb0ea474c83801a0ba4b376d83bfe171b465e61eeab9fbd46b68/diff:/var/lib/docker/overlay2/182b2273f71a8695b8a041e54bb701488b71028091c701a3271bdf6fd0f2c5f5/diff:/var/lib/docker/overlay2/31812fd31cbde39dd1044b048c3f74540d47fbb1dd15634a350ede4f6725dea5/diff:/var/lib/docker/overlay2/58541d8dc75e6a2ece804245b92e88e76345bdbbdda996fbd757eb2290e3e609/diff:/var/lib/docker/overlay2/207a2c171a9595e78850f4fe19c5e78e337c2201f45a4cebc01f869ca7eecf54/diff:/var/lib/docker/overlay2/93569597c37885046de0762af7ba9d6379d54b5533be30cc27f514859f28f7ba/diff:/var/lib/docker/overlay2/57f04579d4692224f2cabd08068218468a37e48174920084405ce9ae88d5d7a7/diff:/var/lib/docker/overlay2/db96b3bbab3bd95dcee0936a5ab318b82dcc941cc09c1fd201e21d97dd5d7617/diff:/var/lib/docker/overlay2/0560b92e88427b3710f730d81a8d910fa8c7feee2a4273c4abb5c51364213d07/diff:/var/lib/docker/overlay2/4e3f380bd40064fcfb56a83f831a38ef53e4ea

bbf36f7661d063e55ccf2972c0/diff:/var/lib/docker/overlay2/65534d10a48ed16cb8b24cc817d40ad1c80c0bbb261a2b966fb4e1bac0f2b524/diff:/var/lib/docker/overlay2/799e74a4ab0cf4fb970c0d6f14af7e37410bf1168fcb40d81c85c773f406f235/diff",

	                "MergedDir": "/var/lib/docker/overlay2/6d359abb314d7bfb2a472b74bfae13c89d61fc9fda0da2fdcee73f107d73eda9/merged",

	                "UpperDir": "/var/lib/docker/overlay2/6d359abb314d7bfb2a472b74bfae13c89d61fc9fda0da2fdcee73f107d73eda9/diff",

	                "WorkDir": "/var/lib/docker/overlay2/6d359abb314d7bfb2a472b74bfae13c89d61fc9fda0da2fdcee73f107d73eda9/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "volume",

	                "Name": "pause-20211231111903-1576",

	                "Source": "/var/lib/docker/volumes/pause-20211231111903-1576/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "pause-20211231111903-1576",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "pause-20211231111903-1576",

	                "name.minikube.sigs.k8s.io": "pause-20211231111903-1576",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "3897f3612e443b75fcab56eb4d499da900ae876f2dfcc1560d0d94085c235110",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "56091"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "56092"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "56093"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "56089"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "56090"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/3897f3612e44",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "pause-20211231111903-1576": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "1c4b9f54092f",

	                        "pause-20211231111903-1576"

	                    ],

	                    "NetworkID": "e8cd998559035760d9e369351cf8a06ee0c2805f4b7230bdcb37f7d029f37d1c",

	                    "EndpointID": "36a5f19fb2d6d046dedc47c1d1cdf9c14f7dbef3a0bf07c43a593e42c799a861",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p pause-20211231111903-1576 -n pause-20211231111903-1576

E1231 11:24:17.054145    1576 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\functional-20211231100252-1576\client.crt: The system cannot find the path specified.

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.Host}} -p pause-20211231111903-1576 -n pause-20211231111903-1576: exit status 2 (8.7645886s)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/PauseAgain FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/PauseAgain]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-windows-amd64.exe -p pause-20211231111903-1576 logs -n 25

=== CONT  TestPause/serial/PauseAgain

helpers_test.go:248: (dbg) Done: out/minikube-windows-amd64.exe -p pause-20211231111903-1576 logs -n 25: (23.8818665s)

helpers_test.go:253: TestPause/serial/PauseAgain logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |------------|------------------------------------------|------------------------------------------|-------------------|---------|-------------------------------|-------------------------------|

	|  Command   |                   Args                   |                 Profile                  |       User        | Version |          Start Time           |           End Time            |

	|------------|------------------------------------------|------------------------------------------|-------------------|---------|-------------------------------|-------------------------------|

	| start      | -p                                       | test-preload-20211231105742-1576         | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:00:48 GMT | Fri, 31 Dec 2021 11:02:59 GMT |

	|            | test-preload-20211231105742-1576         |                                          |                   |         |                               |                               |

	|            | --memory=2200 --alsologtostderr          |                                          |                   |         |                               |                               |

	|            | -v=1 --wait=true --driver=docker         |                                          |                   |         |                               |                               |

	|            | --kubernetes-version=v1.17.3             |                                          |                   |         |                               |                               |

	| ssh        | -p                                       | test-preload-20211231105742-1576         | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:02:59 GMT | Fri, 31 Dec 2021 11:03:06 GMT |

	|            | test-preload-20211231105742-1576         |                                          |                   |         |                               |                               |

	|            | -- docker images                         |                                          |                   |         |                               |                               |

	| delete     | -p                                       | test-preload-20211231105742-1576         | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:03:07 GMT | Fri, 31 Dec 2021 11:03:32 GMT |

	|            | test-preload-20211231105742-1576         |                                          |                   |         |                               |                               |

	| start      | -p                                       | scheduled-stop-20211231110332-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:03:33 GMT | Fri, 31 Dec 2021 11:05:50 GMT |

	|            | scheduled-stop-20211231110332-1576       |                                          |                   |         |                               |                               |

	|            | --memory=2048 --driver=docker            |                                          |                   |         |                               |                               |

	| stop       | -p                                       | scheduled-stop-20211231110332-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:05:51 GMT | Fri, 31 Dec 2021 11:05:56 GMT |

	|            | scheduled-stop-20211231110332-1576       |                                          |                   |         |                               |                               |

	|            | --schedule 5m                            |                                          |                   |         |                               |                               |

	| ssh        | -p                                       | scheduled-stop-20211231110332-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:06:04 GMT | Fri, 31 Dec 2021 11:06:10 GMT |

	|            | scheduled-stop-20211231110332-1576       |                                          |                   |         |                               |                               |

	|            | -- sudo systemctl show                   |                                          |                   |         |                               |                               |

	|            | minikube-scheduled-stop --no-page        |                                          |                   |         |                               |                               |

	| stop       | -p                                       | scheduled-stop-20211231110332-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:06:10 GMT | Fri, 31 Dec 2021 11:06:15 GMT |

	|            | scheduled-stop-20211231110332-1576       |                                          |                   |         |                               |                               |

	|            | --schedule 5s                            |                                          |                   |         |                               |                               |

	| delete     | -p                                       | scheduled-stop-20211231110332-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:07:21 GMT | Fri, 31 Dec 2021 11:07:43 GMT |

	|            | scheduled-stop-20211231110332-1576       |                                          |                   |         |                               |                               |

	| start      | -p                                       | skaffold-20211231110743-1576             | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:07:44 GMT | Fri, 31 Dec 2021 11:10:02 GMT |

	|            | skaffold-20211231110743-1576             |                                          |                   |         |                               |                               |

	|            | --memory=2600 --driver=docker            |                                          |                   |         |                               |                               |

	| docker-env | --shell none -p                          | skaffold-20211231110743-1576             | skaffold          | v1.24.0 | Fri, 31 Dec 2021 11:10:04 GMT | Fri, 31 Dec 2021 11:10:14 GMT |

	|            | skaffold-20211231110743-1576             |                                          |                   |         |                               |                               |

	|            | --user=skaffold                          |                                          |                   |         |                               |                               |

	| delete     | -p                                       | skaffold-20211231110743-1576             | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:11:15 GMT | Fri, 31 Dec 2021 11:11:40 GMT |

	|            | skaffold-20211231110743-1576             |                                          |                   |         |                               |                               |

	| delete     | -p                                       | insufficient-storage-20211231111140-1576 | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:13:31 GMT | Fri, 31 Dec 2021 11:13:52 GMT |

	|            | insufficient-storage-20211231111140-1576 |                                          |                   |         |                               |                               |

	| start      | -p                                       | NoKubernetes-20211231111352-1576         | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:13:53 GMT | Fri, 31 Dec 2021 11:17:25 GMT |

	|            | NoKubernetes-20211231111352-1576         |                                          |                   |         |                               |                               |

	|            | --driver=docker                          |                                          |                   |         |                               |                               |

	| start      | -p                                       | offline-docker-20211231111352-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:13:53 GMT | Fri, 31 Dec 2021 11:18:22 GMT |

	|            | offline-docker-20211231111352-1576       |                                          |                   |         |                               |                               |

	|            | --alsologtostderr -v=1                   |                                          |                   |         |                               |                               |

	|            | --memory=2048 --wait=true                |                                          |                   |         |                               |                               |

	|            | --driver=docker                          |                                          |                   |         |                               |                               |

	| start      | -p                                       | NoKubernetes-20211231111352-1576         | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:17:34 GMT | Fri, 31 Dec 2021 11:18:23 GMT |

	|            | NoKubernetes-20211231111352-1576         |                                          |                   |         |                               |                               |

	|            | --no-kubernetes --driver=docker          |                                          |                   |         |                               |                               |

	| delete     | -p                                       | offline-docker-20211231111352-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:18:22 GMT | Fri, 31 Dec 2021 11:19:03 GMT |

	|            | offline-docker-20211231111352-1576       |                                          |                   |         |                               |                               |

	| delete     | -p                                       | NoKubernetes-20211231111352-1576         | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:18:58 GMT | Fri, 31 Dec 2021 11:19:18 GMT |

	|            | NoKubernetes-20211231111352-1576         |                                          |                   |         |                               |                               |

	| start      | -p                                       | kubernetes-upgrade-20211231111918-1576   | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:19:19 GMT | Fri, 31 Dec 2021 11:22:08 GMT |

	|            | kubernetes-upgrade-20211231111918-1576   |                                          |                   |         |                               |                               |

	|            | --memory=2200                            |                                          |                   |         |                               |                               |

	|            | --kubernetes-version=v1.16.0             |                                          |                   |         |                               |                               |

	|            | --alsologtostderr -v=1 --driver=docker   |                                          |                   |         |                               |                               |

	| stop       | -p                                       | kubernetes-upgrade-20211231111918-1576   | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:22:08 GMT | Fri, 31 Dec 2021 11:22:21 GMT |

	|            | kubernetes-upgrade-20211231111918-1576   |                                          |                   |         |                               |                               |

	| start      | -p pause-20211231111903-1576             | pause-20211231111903-1576                | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:19:03 GMT | Fri, 31 Dec 2021 11:22:33 GMT |

	|            | --memory=2048                            |                                          |                   |         |                               |                               |

	|            | --install-addons=false                   |                                          |                   |         |                               |                               |

	|            | --wait=all --driver=docker               |                                          |                   |         |                               |                               |

	| start      | -p                                       | running-upgrade-20211231111352-1576      | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:21:01 GMT | Fri, 31 Dec 2021 11:22:49 GMT |

	|            | running-upgrade-20211231111352-1576      |                                          |                   |         |                               |                               |

	|            | --memory=2200 --alsologtostderr          |                                          |                   |         |                               |                               |

	|            | -v=1 --driver=docker                     |                                          |                   |         |                               |                               |

	| start      | -p pause-20211231111903-1576             | pause-20211231111903-1576                | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:22:33 GMT | Fri, 31 Dec 2021 11:23:24 GMT |

	|            | --alsologtostderr -v=1                   |                                          |                   |         |                               |                               |

	|            | --driver=docker                          |                                          |                   |         |                               |                               |

	| delete     | -p                                       | running-upgrade-20211231111352-1576      | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:22:49 GMT | Fri, 31 Dec 2021 11:23:27 GMT |

	|            | running-upgrade-20211231111352-1576      |                                          |                   |         |                               |                               |

	| pause      | -p pause-20211231111903-1576             | pause-20211231111903-1576                | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:23:25 GMT | Fri, 31 Dec 2021 11:23:33 GMT |

	|            | --alsologtostderr -v=5                   |                                          |                   |         |                               |                               |

	| unpause    | -p pause-20211231111903-1576             | pause-20211231111903-1576                | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:23:42 GMT | Fri, 31 Dec 2021 11:23:51 GMT |

	|            | --alsologtostderr -v=5                   |                                          |                   |         |                               |                               |

	|------------|------------------------------------------|------------------------------------------|-------------------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/12/31 11:22:33

	Running on machine: minikube7

	Binary: Built with gc go1.17.5 for windows/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1231 11:22:33.283143    6964 out.go:297] Setting OutFile to fd 1476 ...

	I1231 11:22:33.346141    6964 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 11:22:33.346141    6964 out.go:310] Setting ErrFile to fd 1588...

	I1231 11:22:33.346141    6964 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 11:22:33.359162    6964 out.go:304] Setting JSON to false

	I1231 11:22:33.361133    6964 start.go:112] hostinfo: {"hostname":"minikube7","uptime":36194,"bootTime":1640913559,"procs":156,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.18363 Build 18363","kernelVersion":"10.0.18363 Build 18363","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f66ed2ea-6c04-4a6b-8eea-b2fb0953e990"}

	W1231 11:22:33.361133    6964 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1231 11:22:33.367136    6964 out.go:176] * [pause-20211231111903-1576] minikube v1.24.0 on Microsoft Windows 10 Enterprise N 10.0.18363 Build 18363

	I1231 11:22:33.367136    6964 notify.go:174] Checking for updates...

	I1231 11:22:33.371136    6964 out.go:176]   - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 11:22:33.374147    6964 out.go:176]   - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	I1231 11:22:33.376145    6964 out.go:176]   - MINIKUBE_LOCATION=12739

	I1231 11:22:33.023773    4432 out.go:176] * Pulling base image ...

	I1231 11:22:33.023773    4432 preload.go:132] Checking if preload exists for k8s version v1.23.2-rc.0 and runtime docker

	I1231 11:22:33.023773    4432 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b in local docker daemon

	I1231 11:22:33.023773    4432 preload.go:148] Found local preload: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.2-rc.0-docker-overlay2-amd64.tar.lz4

	I1231 11:22:33.024787    4432 cache.go:57] Caching tarball of preloaded images

	I1231 11:22:33.024787    4432 preload.go:174] Found C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.2-rc.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1231 11:22:33.024787    4432 cache.go:60] Finished verifying existence of preloaded tar for  v1.23.2-rc.0 on docker

	I1231 11:22:33.024787    4432 profile.go:147] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\config.json ...

	I1231 11:22:34.423114    4432 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b in local docker daemon, skipping pull

	I1231 11:22:34.423114    4432 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b exists in daemon, skipping load

	I1231 11:22:34.423114    4432 cache.go:206] Successfully downloaded all kic artifacts

	I1231 11:22:34.423114    4432 start.go:313] acquiring machines lock for kubernetes-upgrade-20211231111918-1576: {Name:mk180caff95a643cf3c5b99efd39bcaa55f7621c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1231 11:22:34.423114    4432 start.go:317] acquired machines lock for "kubernetes-upgrade-20211231111918-1576" in 0s

	I1231 11:22:34.423114    4432 start.go:93] Skipping create...Using existing machine configuration

	I1231 11:22:34.423114    4432 fix.go:55] fixHost starting: 

	I1231 11:22:34.434780    4432 cli_runner.go:133] Run: docker container inspect kubernetes-upgrade-20211231111918-1576 --format={{.State.Status}}

	I1231 11:22:30.593445    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.4246221s)

	I1231 11:22:30.596447    7616 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:30.597456    7616 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56202 <nil> <nil>}

	I1231 11:22:30.597456    7616 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\sstopped-upgrade-20211231111352-1576' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 stopped-upgrade-20211231111352-1576/g' /etc/hosts;

				else 

					echo '127.0.1.1 stopped-upgrade-20211231111352-1576' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1231 11:22:30.759928    7616 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1231 11:22:30.759928    7616 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube7\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube7\minikube-integration\.minikube}

	I1231 11:22:30.759928    7616 ubuntu.go:177] setting up certificates

	I1231 11:22:30.759928    7616 provision.go:83] configureAuth start

	I1231 11:22:30.765921    7616 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211231111352-1576

	I1231 11:22:32.257011    7616 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211231111352-1576: (1.4910838s)

	I1231 11:22:32.257011    7616 provision.go:138] copyHostCerts

	I1231 11:22:32.257654    7616 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem, removing ...

	I1231 11:22:32.257732    7616 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.pem

	I1231 11:22:32.257961    7616 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem (1082 bytes)

	I1231 11:22:32.259662    7616 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem, removing ...

	I1231 11:22:32.259662    7616 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cert.pem

	I1231 11:22:32.260158    7616 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem (1123 bytes)

	I1231 11:22:32.261678    7616 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem, removing ...

	I1231 11:22:32.261678    7616 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\key.pem

	I1231 11:22:32.261678    7616 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem (1679 bytes)

	I1231 11:22:32.263642    7616 provision.go:112] generating server cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.stopped-upgrade-20211231111352-1576 san=[172.17.0.2 127.0.0.1 localhost 127.0.0.1 minikube stopped-upgrade-20211231111352-1576]

	I1231 11:22:32.405853    7616 provision.go:172] copyRemoteCerts

	I1231 11:22:32.414858    7616 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1231 11:22:32.421868    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:33.794170    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.3722956s)

	I1231 11:22:33.794170    7616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56202 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\stopped-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:33.917691    7616 ssh_runner.go:235] Completed: sudo mkdir -p /etc/docker /etc/docker /etc/docker: (1.5028267s)

	I1231 11:22:33.918376    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1231 11:22:33.974737    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1277 bytes)

	I1231 11:22:34.021304    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1231 11:22:34.073529    7616 provision.go:86] duration metric: configureAuth took 3.3135865s

	I1231 11:22:34.073529    7616 ubuntu.go:193] setting minikube options for container-runtime

	I1231 11:22:34.073529    7616 config.go:176] Loaded profile config "stopped-upgrade-20211231111352-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I1231 11:22:34.079523    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:35.795125    4432 cli_runner.go:186] Completed: docker container inspect kubernetes-upgrade-20211231111918-1576 --format={{.State.Status}}: (1.3603394s)

	I1231 11:22:35.795125    4432 fix.go:108] recreateIfNeeded on kubernetes-upgrade-20211231111918-1576: state=Stopped err=<nil>

	W1231 11:22:35.795125    4432 fix.go:134] unexpected machine state, will restart: <nil>

	I1231 11:22:33.379141    6964 out.go:176]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1231 11:22:33.380150    6964 config.go:176] Loaded profile config "pause-20211231111903-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.1

	I1231 11:22:33.380150    6964 driver.go:344] Setting default libvirt URI to qemu:///system

	I1231 11:22:36.390741    6964 docker.go:132] docker version: linux-20.10.11

	I1231 11:22:36.398317    6964 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:22:38.877788    6964 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.4794608s)

	I1231 11:22:38.878689    6964 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:79 OomKillDisable:true NGoroutines:56 SystemTime:2021-12-31 11:22:37.7486746 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_

bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:22:35.799095    4432 out.go:176] * Restarting existing docker container for "kubernetes-upgrade-20211231111918-1576" ...

	I1231 11:22:35.804950    4432 cli_runner.go:133] Run: docker start kubernetes-upgrade-20211231111918-1576

	I1231 11:22:35.428238    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.3487095s)

	I1231 11:22:35.431501    7616 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:35.431501    7616 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56202 <nil> <nil>}

	I1231 11:22:35.431501    7616 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1231 11:22:35.606113    7616 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I1231 11:22:35.606113    7616 ubuntu.go:71] root file system type: overlay

	I1231 11:22:35.606113    7616 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1231 11:22:35.613101    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:37.071538    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.4584314s)

	I1231 11:22:37.074544    7616 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:37.074544    7616 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56202 <nil> <nil>}

	I1231 11:22:37.074544    7616 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1231 11:22:37.291110    7616 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1231 11:22:37.297098    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:38.714653    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.4175488s)

	I1231 11:22:38.717622    7616 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:38.717622    7616 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56202 <nil> <nil>}

	I1231 11:22:38.717622    7616 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1231 11:22:38.882202    6964 out.go:176] * Using the docker driver based on existing profile

	I1231 11:22:38.882279    6964 start.go:280] selected driver: docker

	I1231 11:22:38.882279    6964 start.go:795] validating driver "docker" against &{Name:pause-20211231111903-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.1 ClusterName:pause-20211231111903-1576 Namespace:default APIServerName:miniku

beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.23.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Moun

tOptions:[] MountPort:0 MountType:9p MountUID:docker}

	I1231 11:22:38.882279    6964 start.go:806] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I1231 11:22:38.882279    6964 start.go:1498] auto setting extra-config to "kubelet.global-housekeeping-interval=60m".

	I1231 11:22:38.882279    6964 start.go:1498] auto setting extra-config to "kubelet.housekeeping-interval=5m".

	I1231 11:22:38.908127    6964 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:22:41.327029    6964 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.4186983s)

	I1231 11:22:41.327244    6964 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:80 OomKillDisable:true NGoroutines:57 SystemTime:2021-12-31 11:22:40.2042358 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_

bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:22:41.379148    6964 cni.go:93] Creating CNI manager for ""

	I1231 11:22:41.379148    6964 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:22:41.379148    6964 start_flags.go:298] config:

	{Name:pause-20211231111903-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.1 ClusterName:pause-20211231111903-1576 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:

docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.23.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker}

	I1231 11:22:41.383165    6964 out.go:176] * Starting control plane node pause-20211231111903-1576 in cluster pause-20211231111903-1576

	I1231 11:22:41.383165    6964 cache.go:118] Beginning downloading kic base image for docker with docker

	I1231 11:22:42.068483   10208 out.go:203]   - Generating certificates and keys ...

	I1231 11:22:42.074477   10208 out.go:203]   - Booting up control plane ...

	I1231 11:22:41.386146    6964 out.go:176] * Pulling base image ...

	I1231 11:22:41.386146    6964 preload.go:132] Checking if preload exists for k8s version v1.23.1 and runtime docker

	I1231 11:22:41.386146    6964 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b in local docker daemon

	I1231 11:22:41.386146    6964 preload.go:148] Found local preload: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.1-docker-overlay2-amd64.tar.lz4

	I1231 11:22:41.386146    6964 cache.go:57] Caching tarball of preloaded images

	I1231 11:22:41.387153    6964 preload.go:174] Found C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1231 11:22:41.387153    6964 cache.go:60] Finished verifying existence of preloaded tar for  v1.23.1 on docker

	I1231 11:22:41.387153    6964 profile.go:147] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\config.json ...

	I1231 11:22:42.797711    6964 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b in local docker daemon, skipping pull

	I1231 11:22:42.797711    6964 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b exists in daemon, skipping load

	I1231 11:22:42.797711    6964 cache.go:206] Successfully downloaded all kic artifacts

	I1231 11:22:42.797711    6964 start.go:313] acquiring machines lock for pause-20211231111903-1576: {Name:mkd1ba6d04e1b7c72c7ae1ec3fb5922177e82911 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1231 11:22:42.797711    6964 start.go:317] acquired machines lock for "pause-20211231111903-1576" in 0s

	I1231 11:22:42.797711    6964 start.go:93] Skipping create...Using existing machine configuration

	I1231 11:22:42.797711    6964 fix.go:55] fixHost starting: 

	I1231 11:22:42.809709    6964 cli_runner.go:133] Run: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}

	I1231 11:22:42.079474   10208 out.go:203]   - Configuring RBAC rules ...

	I1231 11:22:42.083481   10208 cni.go:93] Creating CNI manager for ""

	I1231 11:22:42.083481   10208 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:22:42.083481   10208 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1231 11:22:42.096472   10208 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1231 11:22:42.098487   10208 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.0/kubectl label nodes minikube.k8s.io/version=v1.24.0 minikube.k8s.io/commit=a81813405fc4902e1caabd8d69223ec230d201fb minikube.k8s.io/name=running-upgrade-20211231111352-1576 minikube.k8s.io/updated_at=2021_12_31T11_22_42_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I1231 11:22:42.156308   10208 ops.go:34] apiserver oom_adj: -16

	I1231 11:22:42.765714   10208 kubeadm.go:864] duration metric: took 682.2299ms to wait for elevateKubeSystemPrivileges.

	I1231 11:22:42.765714   10208 kubeadm.go:390] StartCluster complete in 31.7846151s

	I1231 11:22:42.765714   10208 settings.go:142] acquiring lock: {Name:mk2f48f1c2db86c45c5c20d13312e07e9c171d09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:22:42.766732   10208 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 11:22:42.767730   10208 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:22:42.780714   10208 kapi.go:59] client config for running-upgrade-20211231111352-1576: &rest.Config{Host:"https://127.0.0.1:56017", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\running-upgrade-20211231111352-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\running-upgrade-20211231111352-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", Ce

rtData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:22:43.443850   10208 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "running-upgrade-20211231111352-1576" rescaled to 1

	I1231 11:22:43.444186   10208 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1231 11:22:43.444235   10208 start.go:206] Will wait 6m0s for node &{Name:m01 IP:172.17.0.3 Port:8443 KubernetesVersion:v1.18.0 ControlPlane:true Worker:true}

	I1231 11:22:44.289621    6964 cli_runner.go:186] Completed: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}: (1.4798513s)

	I1231 11:22:44.289621    6964 fix.go:108] recreateIfNeeded on pause-20211231111903-1576: state=Running err=<nil>

	W1231 11:22:44.289621    6964 fix.go:134] unexpected machine state, will restart: <nil>

	I1231 11:22:44.402592    4432 cli_runner.go:186] Completed: docker start kubernetes-upgrade-20211231111918-1576: (8.597606s)

	I1231 11:22:44.410587    4432 cli_runner.go:133] Run: docker container inspect kubernetes-upgrade-20211231111918-1576 --format={{.State.Status}}

	I1231 11:22:43.448214   10208 out.go:176] * Verifying Kubernetes components...

	I1231 11:22:43.444235   10208 addons.go:415] enableAddons start: toEnable=map[default-storageclass:true storage-provisioner:true], additional=[]

	I1231 11:22:43.444989   10208 config.go:176] Loaded profile config "running-upgrade-20211231111352-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I1231 11:22:43.448357   10208 addons.go:65] Setting storage-provisioner=true in profile "running-upgrade-20211231111352-1576"

	I1231 11:22:43.448357   10208 addons.go:65] Setting default-storageclass=true in profile "running-upgrade-20211231111352-1576"

	I1231 11:22:43.448357   10208 addons.go:153] Setting addon storage-provisioner=true in "running-upgrade-20211231111352-1576"

	W1231 11:22:43.448357   10208 addons.go:165] addon storage-provisioner should already be in state true

	I1231 11:22:43.448357   10208 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "running-upgrade-20211231111352-1576"

	I1231 11:22:43.448357   10208 host.go:66] Checking if "running-upgrade-20211231111352-1576" exists ...

	I1231 11:22:43.464086   10208 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1231 11:22:43.471094   10208 cli_runner.go:133] Run: docker container inspect running-upgrade-20211231111352-1576 --format={{.State.Status}}

	I1231 11:22:43.472081   10208 cli_runner.go:133] Run: docker container inspect running-upgrade-20211231111352-1576 --format={{.State.Status}}

	I1231 11:22:44.249106   10208 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.2 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1231 11:22:44.270004   10208 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" running-upgrade-20211231111352-1576

	I1231 11:22:45.096957   10208 cli_runner.go:186] Completed: docker container inspect running-upgrade-20211231111352-1576 --format={{.State.Status}}: (1.6258565s)

	I1231 11:22:45.101953   10208 out.go:176]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1231 11:22:45.101953   10208 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1231 11:22:45.101953   10208 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1231 11:22:45.112970   10208 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211231111352-1576

	I1231 11:22:45.123982   10208 cli_runner.go:186] Completed: docker container inspect running-upgrade-20211231111352-1576 --format={{.State.Status}}: (1.6518938s)

	I1231 11:22:45.125979   10208 kapi.go:59] client config for running-upgrade-20211231111352-1576: &rest.Config{Host:"https://127.0.0.1:56017", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\running-upgrade-20211231111352-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\running-upgrade-20211231111352-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", Ce

rtData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:22:45.160975   10208 addons.go:153] Setting addon default-storageclass=true in "running-upgrade-20211231111352-1576"

	W1231 11:22:45.161964   10208 addons.go:165] addon default-storageclass should already be in state true

	I1231 11:22:45.161964   10208 host.go:66] Checking if "running-upgrade-20211231111352-1576" exists ...

	I1231 11:22:45.178957   10208 cli_runner.go:133] Run: docker container inspect running-upgrade-20211231111352-1576 --format={{.State.Status}}

	I1231 11:22:45.673148   10208 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.2 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.4240361s)

	I1231 11:22:45.675151   10208 start.go:773] {"host.minikube.internal": 192.168.65.2} host record injected into CoreDNS

	I1231 11:22:44.293597    6964 out.go:176] * Updating the running docker "pause-20211231111903-1576" container ...

	I1231 11:22:44.293597    6964 machine.go:88] provisioning docker machine ...

	I1231 11:22:44.293597    6964 ubuntu.go:169] provisioning hostname "pause-20211231111903-1576"

	I1231 11:22:44.303646    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:46.107233    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.8035791s)

	I1231 11:22:46.111207    6964 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:46.112209    6964 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56091 <nil> <nil>}

	I1231 11:22:46.112209    6964 main.go:130] libmachine: About to run SSH command:

	sudo hostname pause-20211231111903-1576 && echo "pause-20211231111903-1576" | sudo tee /etc/hostname

	I1231 11:22:46.352563    6964 main.go:130] libmachine: SSH cmd err, output: <nil>: pause-20211231111903-1576

	I1231 11:22:46.365063    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:47.970388    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.6053178s)

	I1231 11:22:47.973367    6964 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:47.973367    6964 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56091 <nil> <nil>}

	I1231 11:22:47.973367    6964 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\spause-20211231111903-1576' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 pause-20211231111903-1576/g' /etc/hosts;

				else 

					echo '127.0.1.1 pause-20211231111903-1576' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1231 11:22:46.094238   10208 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" running-upgrade-20211231111352-1576: (1.8242263s)

	I1231 11:22:46.094238   10208 kubeadm.go:479] skip waiting for components based on config.

	I1231 11:22:46.094238   10208 node_conditions.go:102] verifying NodePressure condition ...

	I1231 11:22:46.125227   10208 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I1231 11:22:46.125227   10208 node_conditions.go:123] node cpu capacity is 16

	I1231 11:22:46.125227   10208 node_conditions.go:105] duration metric: took 30.9883ms to run NodePressure ...

	I1231 11:22:46.125227   10208 start.go:211] waiting for startup goroutines ...

	I1231 11:22:46.843687   10208 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211231111352-1576: (1.7307098s)

	I1231 11:22:46.843687   10208 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56015 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\running-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:46.894686   10208 cli_runner.go:186] Completed: docker container inspect running-upgrade-20211231111352-1576 --format={{.State.Status}}: (1.7157217s)

	I1231 11:22:46.894686   10208 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml

	I1231 11:22:46.894686   10208 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1231 11:22:46.901683   10208 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211231111352-1576

	I1231 11:22:47.009694   10208 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1231 11:22:48.472802   10208 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211231111352-1576: (1.5711125s)

	I1231 11:22:48.473515   10208 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56015 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\running-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:48.632995   10208 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1231 11:22:48.947955   10208 out.go:176] * Enabled addons: storage-provisioner, default-storageclass

	I1231 11:22:48.947955   10208 addons.go:417] enableAddons completed in 5.503697s

	I1231 11:22:49.145589   10208 start.go:493] kubectl: 1.18.2, cluster: 1.18.0 (minor skew: 0)

	I1231 11:22:49.149541   10208 out.go:176] * Done! kubectl is now configured to use "running-upgrade-20211231111352-1576" cluster and "" namespace by default

	I1231 11:22:46.202563    4432 cli_runner.go:186] Completed: docker container inspect kubernetes-upgrade-20211231111918-1576 --format={{.State.Status}}: (1.791968s)

	I1231 11:22:46.202563    4432 kic.go:420] container "kubernetes-upgrade-20211231111918-1576" state is running.

	I1231 11:22:46.213567    4432 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:47.834365    4432 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211231111918-1576: (1.6207913s)

	I1231 11:22:47.834365    4432 profile.go:147] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\config.json ...

	I1231 11:22:47.837382    4432 machine.go:88] provisioning docker machine ...

	I1231 11:22:47.837382    4432 ubuntu.go:169] provisioning hostname "kubernetes-upgrade-20211231111918-1576"

	I1231 11:22:47.843372    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:49.338540    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.4951613s)

	I1231 11:22:49.341544    4432 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:49.342541    4432 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56222 <nil> <nil>}

	I1231 11:22:49.342541    4432 main.go:130] libmachine: About to run SSH command:

	sudo hostname kubernetes-upgrade-20211231111918-1576 && echo "kubernetes-upgrade-20211231111918-1576" | sudo tee /etc/hostname

	I1231 11:22:45.540570    7616 main.go:130] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2021-12-31 11:16:45.568623600 +0000

	+++ /lib/systemd/system/docker.service.new	2021-12-31 11:22:37.248623600 +0000

	@@ -5,9 +5,12 @@

	 After=network-online.target firewalld.service containerd.service

	 Wants=network-online.target

	 Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	+Restart=on-failure

	@@ -23,7 +26,7 @@

	 # container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	 ExecStart=

	 ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	-ExecReload=/bin/kill -s HUP 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	I1231 11:22:45.540570    7616 machine.go:91] provisioned docker machine in 17.9656126s

	I1231 11:22:45.541559    7616 start.go:267] post-start starting for "stopped-upgrade-20211231111352-1576" (driver="docker")

	I1231 11:22:45.541559    7616 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1231 11:22:45.554566    7616 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1231 11:22:45.564553    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:47.249693    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.6851327s)

	I1231 11:22:47.250090    7616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56202 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\stopped-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:47.417404    7616 ssh_runner.go:235] Completed: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs: (1.8628309s)

	I1231 11:22:47.429393    7616 ssh_runner.go:195] Run: cat /etc/os-release

	I1231 11:22:47.444370    7616 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1231 11:22:47.444370    7616 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1231 11:22:47.444370    7616 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1231 11:22:47.444370    7616 info.go:137] Remote host: Ubuntu 19.10

	I1231 11:22:47.444370    7616 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\addons for local assets ...

	I1231 11:22:47.444370    7616 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\files for local assets ...

	I1231 11:22:47.446377    7616 filesync.go:149] local asset: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem -> 15762.pem in /etc/ssl/certs

	I1231 11:22:47.458391    7616 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1231 11:22:47.491371    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem --> /etc/ssl/certs/15762.pem (1708 bytes)

	I1231 11:22:47.545389    7616 start.go:270] post-start completed in 2.0038218s

	I1231 11:22:47.558380    7616 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1231 11:22:47.565377    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:49.048783    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.4834005s)

	I1231 11:22:49.048783    7616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56202 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\stopped-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:49.125569    7616 ssh_runner.go:235] Completed: sh -c "df -h /var | awk 'NR==2{print $5}'": (1.5671818s)

	I1231 11:22:49.125569    7616 fix.go:57] fixHost completed within 29.3720642s

	I1231 11:22:49.125569    7616 start.go:80] releasing machines lock for "stopped-upgrade-20211231111352-1576", held for 29.3720642s

	I1231 11:22:49.132553    7616 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211231111352-1576

	I1231 11:22:48.190948    6964 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1231 11:22:48.190948    6964 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube7\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube7\minikube-integration\.minikube}

	I1231 11:22:48.190948    6964 ubuntu.go:177] setting up certificates

	I1231 11:22:48.190948    6964 provision.go:83] configureAuth start

	I1231 11:22:48.199948    6964 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" pause-20211231111903-1576

	I1231 11:22:49.669546    6964 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" pause-20211231111903-1576: (1.4695917s)

	I1231 11:22:49.669546    6964 provision.go:138] copyHostCerts

	I1231 11:22:49.669546    6964 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem, removing ...

	I1231 11:22:49.669546    6964 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.pem

	I1231 11:22:49.669546    6964 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem (1082 bytes)

	I1231 11:22:49.670568    6964 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem, removing ...

	I1231 11:22:49.671537    6964 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cert.pem

	I1231 11:22:49.671537    6964 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem (1123 bytes)

	I1231 11:22:49.672535    6964 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem, removing ...

	I1231 11:22:49.672535    6964 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\key.pem

	I1231 11:22:49.672535    6964 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem (1679 bytes)

	I1231 11:22:49.673559    6964 provision.go:112] generating server cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.pause-20211231111903-1576 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube pause-20211231111903-1576]

	I1231 11:22:49.967393    6964 provision.go:172] copyRemoteCerts

	I1231 11:22:49.974406    6964 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1231 11:22:49.981388    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:51.437468    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.4559971s)

	I1231 11:22:51.439124    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:22:51.591341    6964 ssh_runner.go:235] Completed: sudo mkdir -p /etc/docker /etc/docker /etc/docker: (1.6159441s)

	I1231 11:22:51.592362    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1231 11:22:51.647405    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1249 bytes)

	I1231 11:22:51.709768    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1231 11:22:51.766474    6964 provision.go:86] duration metric: configureAuth took 3.5754519s

	I1231 11:22:51.766474    6964 ubuntu.go:193] setting minikube options for container-runtime

	I1231 11:22:51.767552    6964 config.go:176] Loaded profile config "pause-20211231111903-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.1

	I1231 11:22:51.778182    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:50.568718    7616 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211231111352-1576: (1.4361594s)

	I1231 11:22:50.570749    7616 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I1231 11:22:50.576710    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:50.577731    7616 ssh_runner.go:195] Run: systemctl --version

	I1231 11:22:50.583710    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:52.199158    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.6224415s)

	I1231 11:22:52.199158    7616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56202 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\stopped-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:52.203142    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.6194253s)

	I1231 11:22:52.203142    7616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56202 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\stopped-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:52.401908    7616 ssh_runner.go:235] Completed: curl -sS -m 2 https://k8s.gcr.io/: (1.8311518s)

	I1231 11:22:52.401908    7616 ssh_runner.go:235] Completed: systemctl --version: (1.8241697s)

	I1231 11:22:52.409897    7616 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1231 11:22:52.445915    7616 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1231 11:22:52.472894    7616 cruntime.go:264] skipping containerd shutdown because we are bound to it

	I1231 11:22:52.483911    7616 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1231 11:22:52.512881    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I1231 11:22:52.569893    7616 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1231 11:22:52.775892    7616 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1231 11:22:52.920907    7616 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1231 11:22:52.956914    7616 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1231 11:22:53.115911    7616 ssh_runner.go:195] Run: sudo systemctl start docker

	I1231 11:22:53.152914    7616 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1231 11:22:53.345836    7616 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1231 11:22:49.584548    4432 main.go:130] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-20211231111918-1576

	I1231 11:22:49.593563    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:51.019754    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.4261847s)

	I1231 11:22:51.022748    4432 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:51.023753    4432 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56222 <nil> <nil>}

	I1231 11:22:51.023753    4432 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\skubernetes-upgrade-20211231111918-1576' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kubernetes-upgrade-20211231111918-1576/g' /etc/hosts;

				else 

					echo '127.0.1.1 kubernetes-upgrade-20211231111918-1576' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1231 11:22:51.250944    4432 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1231 11:22:51.250944    4432 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube7\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube7\minikube-integration\.minikube}

	I1231 11:22:51.250944    4432 ubuntu.go:177] setting up certificates

	I1231 11:22:51.250944    4432 provision.go:83] configureAuth start

	I1231 11:22:51.263898    4432 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:52.899897    4432 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211231111918-1576: (1.6359916s)

	I1231 11:22:52.899897    4432 provision.go:138] copyHostCerts

	I1231 11:22:52.899897    4432 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem, removing ...

	I1231 11:22:52.899897    4432 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.pem

	I1231 11:22:52.899897    4432 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem (1082 bytes)

	I1231 11:22:52.901897    4432 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem, removing ...

	I1231 11:22:52.901897    4432 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cert.pem

	I1231 11:22:52.901897    4432 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem (1123 bytes)

	I1231 11:22:52.902915    4432 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem, removing ...

	I1231 11:22:52.902915    4432 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\key.pem

	I1231 11:22:52.903895    4432 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem (1679 bytes)

	I1231 11:22:52.904886    4432 provision.go:112] generating server cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.kubernetes-upgrade-20211231111918-1576 san=[192.168.58.2 127.0.0.1 localhost 127.0.0.1 minikube kubernetes-upgrade-20211231111918-1576]

	I1231 11:22:53.110877    4432 provision.go:172] copyRemoteCerts

	I1231 11:22:53.120890    4432 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1231 11:22:53.131877    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:53.471060    7616 out.go:203] * Preparing Kubernetes v1.18.0 on Docker 19.03.2 ...

	I1231 11:22:53.478084    7616 cli_runner.go:133] Run: docker exec -t stopped-upgrade-20211231111352-1576 dig +short host.docker.internal

	I1231 11:22:55.496399    7616 cli_runner.go:186] Completed: docker exec -t stopped-upgrade-20211231111352-1576 dig +short host.docker.internal: (2.0183073s)

	I1231 11:22:55.496399    7616 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2

	I1231 11:22:55.506392    7616 ssh_runner.go:195] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I1231 11:22:55.518401    7616 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1231 11:22:55.565414    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:57.098107    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.5326864s)

	I1231 11:22:53.367833    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.5896447s)

	I1231 11:22:53.370839    6964 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:53.371847    6964 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56091 <nil> <nil>}

	I1231 11:22:53.371847    6964 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1231 11:22:53.569118    6964 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I1231 11:22:53.569118    6964 ubuntu.go:71] root file system type: overlay

	I1231 11:22:53.570071    6964 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1231 11:22:53.578077    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:55.151001    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.5729178s)

	I1231 11:22:55.154990    6964 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:55.154990    6964 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56091 <nil> <nil>}

	I1231 11:22:55.154990    6964 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1231 11:22:55.457404    6964 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1231 11:22:55.463392    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:57.002836    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.5394377s)

	I1231 11:22:57.007844    6964 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:57.007844    6964 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56091 <nil> <nil>}

	I1231 11:22:57.007844    6964 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1231 11:22:57.245110    6964 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1231 11:22:57.245110    6964 machine.go:91] provisioned docker machine in 12.9514587s

	I1231 11:22:57.245110    6964 start.go:267] post-start starting for "pause-20211231111903-1576" (driver="docker")

	I1231 11:22:57.245110    6964 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1231 11:22:57.263115    6964 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1231 11:22:57.278120    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:54.700209    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.5683253s)

	I1231 11:22:54.700484    4432 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56222 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\kubernetes-upgrade-20211231111918-1576\id_rsa Username:docker}

	I1231 11:22:54.851920    4432 ssh_runner.go:235] Completed: sudo mkdir -p /etc/docker /etc/docker /etc/docker: (1.7310229s)

	I1231 11:22:54.851920    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1231 11:22:54.911919    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1285 bytes)

	I1231 11:22:54.962928    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1231 11:22:55.016926    4432 provision.go:86] duration metric: configureAuth took 3.7659657s

	I1231 11:22:55.016926    4432 ubuntu.go:193] setting minikube options for container-runtime

	I1231 11:22:55.017921    4432 config.go:176] Loaded profile config "kubernetes-upgrade-20211231111918-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.2-rc.0

	I1231 11:22:55.022928    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:56.558878    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.5359444s)

	I1231 11:22:56.563875    4432 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:56.564864    4432 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56222 <nil> <nil>}

	I1231 11:22:56.564864    4432 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1231 11:22:56.778822    4432 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I1231 11:22:56.778822    4432 ubuntu.go:71] root file system type: overlay

	I1231 11:22:56.779832    4432 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1231 11:22:56.787843    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:58.346076    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.5582264s)

	I1231 11:22:58.349733    4432 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:58.349927    4432 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56222 <nil> <nil>}

	I1231 11:22:58.349927    4432 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1231 11:22:58.690992    4432 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1231 11:22:58.702968    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:57.103112    7616 out.go:176]   - kubeadm.pod-network-cidr=10.244.0.0/16

	I1231 11:22:57.103112    7616 preload.go:132] Checking if preload exists for k8s version v1.18.0 and runtime docker

	I1231 11:22:57.110204    7616 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1231 11:22:57.220105    7616 docker.go:581] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-proxy:v1.18.0

	k8s.gcr.io/kube-scheduler:v1.18.0

	k8s.gcr.io/kube-controller-manager:v1.18.0

	k8s.gcr.io/kube-apiserver:v1.18.0

	kubernetesui/dashboard:v2.0.0-rc6

	k8s.gcr.io/pause:3.2

	k8s.gcr.io/coredns:1.6.7

	kindest/kindnetd:0.5.3

	k8s.gcr.io/etcd:3.4.3-0

	kubernetesui/metrics-scraper:v1.0.2

	gcr.io/k8s-minikube/storage-provisioner:v1.8.1

	-- /stdout --

	I1231 11:22:57.220105    7616 docker.go:587] gcr.io/k8s-minikube/storage-provisioner:v5 wasn't preloaded

	I1231 11:22:57.220105    7616 cache_images.go:88] LoadImages start: [k8s.gcr.io/kube-apiserver:v1.18.0 k8s.gcr.io/kube-controller-manager:v1.18.0 k8s.gcr.io/kube-scheduler:v1.18.0 k8s.gcr.io/kube-proxy:v1.18.0 k8s.gcr.io/pause:3.2 k8s.gcr.io/etcd:3.4.3-0 k8s.gcr.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5 docker.io/kubernetesui/dashboard:v2.3.1 docker.io/kubernetesui/metrics-scraper:v1.0.7]

	I1231 11:22:57.248122    7616 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1231 11:22:57.255156    7616 image.go:134] retrieving image: k8s.gcr.io/kube-apiserver:v1.18.0

	I1231 11:22:57.267133    7616 image.go:134] retrieving image: docker.io/kubernetesui/dashboard:v2.3.1

	I1231 11:22:57.270144    7616 image.go:134] retrieving image: k8s.gcr.io/kube-controller-manager:v1.18.0

	I1231 11:22:57.272110    7616 image.go:180] daemon lookup for k8s.gcr.io/kube-apiserver:v1.18.0: Error response from daemon: reference does not exist

	I1231 11:22:57.279133    7616 image.go:134] retrieving image: k8s.gcr.io/coredns:1.6.7

	I1231 11:22:57.282128    7616 image.go:134] retrieving image: k8s.gcr.io/kube-scheduler:v1.18.0

	I1231 11:22:57.289120    7616 image.go:180] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: reference does not exist

	I1231 11:22:57.293147    7616 image.go:134] retrieving image: k8s.gcr.io/kube-proxy:v1.18.0

	I1231 11:22:57.302109    7616 image.go:180] daemon lookup for k8s.gcr.io/coredns:1.6.7: Error response from daemon: reference does not exist

	I1231 11:22:57.306126    7616 image.go:180] daemon lookup for docker.io/kubernetesui/dashboard:v2.3.1: Error response from daemon: reference does not exist

	I1231 11:22:57.313171    7616 image.go:180] daemon lookup for k8s.gcr.io/kube-scheduler:v1.18.0: Error response from daemon: reference does not exist

	I1231 11:22:57.323143    7616 image.go:134] retrieving image: docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1231 11:22:57.332114    7616 image.go:134] retrieving image: k8s.gcr.io/pause:3.2

	I1231 11:22:57.333134    7616 image.go:180] daemon lookup for docker.io/kubernetesui/metrics-scraper:v1.0.7: Error response from daemon: reference does not exist

	I1231 11:22:57.355116    7616 image.go:180] daemon lookup for k8s.gcr.io/kube-proxy:v1.18.0: Error response from daemon: reference does not exist

	I1231 11:22:57.365122    7616 image.go:180] daemon lookup for k8s.gcr.io/pause:3.2: Error response from daemon: reference does not exist

	I1231 11:22:57.379119    7616 image.go:180] daemon lookup for k8s.gcr.io/kube-controller-manager:v1.18.0: Error response from daemon: reference does not exist

	I1231 11:22:57.385115    7616 image.go:134] retrieving image: k8s.gcr.io/etcd:3.4.3-0

	I1231 11:22:57.394129    7616 image.go:180] daemon lookup for k8s.gcr.io/etcd:3.4.3-0: Error response from daemon: reference does not exist

	W1231 11:22:57.635418    7616 image.go:190] authn lookup for k8s.gcr.io/kube-apiserver:v1.18.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:22:57.813595    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/kube-apiserver:v1.18.0

	W1231 11:22:57.952049    7616 image.go:190] authn lookup for gcr.io/k8s-minikube/storage-provisioner:v5 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:22:58.162526    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5

	I1231 11:22:58.268444    7616 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime

	I1231 11:22:58.268444    7616 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner:v5 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v5

	I1231 11:22:58.268444    7616 docker.go:262] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5

	W1231 11:22:58.273452    7616 image.go:190] authn lookup for k8s.gcr.io/coredns:1.6.7 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:22:58.278436    7616 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5

	I1231 11:22:58.374941    7616 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v5

	I1231 11:22:58.382957    7616 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5

	I1231 11:22:58.393944    7616 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory

	I1231 11:22:58.393944    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (9060352 bytes)

	I1231 11:22:58.435989    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/coredns:1.6.7

	W1231 11:22:58.621953    7616 image.go:190] authn lookup for docker.io/kubernetesui/dashboard:v2.3.1 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	W1231 11:22:59.008954    7616 image.go:190] authn lookup for k8s.gcr.io/kube-scheduler:v1.18.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:22:59.008954    7616 docker.go:229] Loading image: /var/lib/minikube/images/storage-provisioner_v5

	I1231 11:22:59.008954    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/storage-provisioner_v5 | docker load"

	I1231 11:22:59.172356    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/kube-scheduler:v1.18.0

	I1231 11:22:59.233307    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} docker.io/kubernetesui/dashboard:v2.3.1

	W1231 11:22:59.375832    7616 image.go:190] authn lookup for docker.io/kubernetesui/metrics-scraper:v1.0.7 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:22:59.702282    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} docker.io/kubernetesui/metrics-scraper:v1.0.7

	W1231 11:22:59.730294    7616 image.go:190] authn lookup for k8s.gcr.io/kube-proxy:v1.18.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:22:59.891972    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/kube-proxy:v1.18.0

	I1231 11:22:58.869983    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.5918571s)

	I1231 11:22:58.869983    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:22:59.015957    6964 ssh_runner.go:235] Completed: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs: (1.7518002s)

	I1231 11:22:59.025942    6964 ssh_runner.go:195] Run: cat /etc/os-release

	I1231 11:22:59.035956    6964 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1231 11:22:59.035956    6964 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1231 11:22:59.035956    6964 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1231 11:22:59.035956    6964 info.go:137] Remote host: Ubuntu 20.04.2 LTS

	I1231 11:22:59.035956    6964 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\addons for local assets ...

	I1231 11:22:59.036952    6964 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\files for local assets ...

	I1231 11:22:59.038955    6964 filesync.go:149] local asset: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem -> 15762.pem in /etc/ssl/certs

	I1231 11:22:59.054988    6964 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1231 11:22:59.082952    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem --> /etc/ssl/certs/15762.pem (1708 bytes)

	I1231 11:22:59.134144    6964 start.go:270] post-start completed in 1.8890259s

	I1231 11:22:59.148306    6964 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1231 11:22:59.157325    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:00.804999    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.6476666s)

	I1231 11:23:00.804999    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:23:00.955603    6964 ssh_runner.go:235] Completed: sh -c "df -h /var | awk 'NR==2{print $5}'": (1.8072896s)

	I1231 11:23:00.955603    6964 fix.go:57] fixHost completed within 18.1578155s

	I1231 11:23:00.955603    6964 start.go:80] releasing machines lock for "pause-20211231111903-1576", held for 18.1578155s

	I1231 11:23:00.962587    6964 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" pause-20211231111903-1576

	I1231 11:23:02.626605    6964 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" pause-20211231111903-1576: (1.6640114s)

	I1231 11:23:02.629587    6964 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I1231 11:23:02.640576    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:02.642579    6964 ssh_runner.go:195] Run: systemctl --version

	I1231 11:23:02.652579    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:00.376902    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.6739273s)

	I1231 11:23:00.380354    4432 main.go:130] libmachine: Using SSH client type: native

	I1231 11:23:00.380952    4432 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56222 <nil> <nil>}

	I1231 11:23:00.380952    4432 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1231 11:23:00.599443    4432 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1231 11:23:00.599443    4432 machine.go:91] provisioned docker machine in 12.7620076s

	I1231 11:23:00.599443    4432 start.go:267] post-start starting for "kubernetes-upgrade-20211231111918-1576" (driver="docker")

	I1231 11:23:00.599443    4432 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1231 11:23:00.608461    4432 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1231 11:23:00.616454    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:23:02.291586    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.6751251s)

	I1231 11:23:02.291586    4432 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56222 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\kubernetes-upgrade-20211231111918-1576\id_rsa Username:docker}

	I1231 11:23:02.494623    4432 ssh_runner.go:235] Completed: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs: (1.8861541s)

	I1231 11:23:02.506593    4432 ssh_runner.go:195] Run: cat /etc/os-release

	I1231 11:23:02.520578    4432 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1231 11:23:02.520578    4432 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1231 11:23:02.520578    4432 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1231 11:23:02.520578    4432 info.go:137] Remote host: Ubuntu 20.04.2 LTS

	I1231 11:23:02.520578    4432 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\addons for local assets ...

	I1231 11:23:02.520578    4432 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\files for local assets ...

	I1231 11:23:02.522612    4432 filesync.go:149] local asset: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem -> 15762.pem in /etc/ssl/certs

	I1231 11:23:02.533586    4432 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1231 11:23:02.564582    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem --> /etc/ssl/certs/15762.pem (1708 bytes)

	I1231 11:23:02.634586    4432 start.go:270] post-start completed in 2.0351345s

	I1231 11:23:02.649575    4432 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1231 11:23:02.659575    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:23:04.423849    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.7642664s)

	I1231 11:23:04.423849    4432 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56222 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\kubernetes-upgrade-20211231111918-1576\id_rsa Username:docker}

	W1231 11:23:00.119624    7616 image.go:190] authn lookup for k8s.gcr.io/pause:3.2 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:23:00.315268    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/pause:3.2

	W1231 11:23:00.482934    7616 image.go:190] authn lookup for k8s.gcr.io/kube-controller-manager:v1.18.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:23:00.649103    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/kube-controller-manager:v1.18.0

	I1231 11:23:00.801005    7616 ssh_runner.go:235] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/storage-provisioner_v5 | docker load": (1.7920427s)

	I1231 11:23:00.801005    7616 cache_images.go:315] Transferred and loaded C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v5 from cache

	I1231 11:23:00.801005    7616 ssh_runner.go:235] Completed: docker image inspect --format {{.Id}} k8s.gcr.io/kube-scheduler:v1.18.0: (1.6286415s)

	I1231 11:23:00.801005    7616 ssh_runner.go:235] Completed: docker image inspect --format {{.Id}} docker.io/kubernetesui/dashboard:v2.3.1: (1.5666906s)

	I1231 11:23:00.801005    7616 ssh_runner.go:235] Completed: docker image inspect --format {{.Id}} docker.io/kubernetesui/metrics-scraper:v1.0.7: (1.0987182s)

	I1231 11:23:00.801005    7616 cache_images.go:116] "docker.io/kubernetesui/dashboard:v2.3.1" needs transfer: "docker.io/kubernetesui/dashboard:v2.3.1" does not exist at hash "e1482a24335a6e76d438ae175f79409004588570d3e5dbb4c8140e025e848570" in container runtime

	I1231 11:23:00.801005    7616 cache_images.go:116] "docker.io/kubernetesui/metrics-scraper:v1.0.7" needs transfer: "docker.io/kubernetesui/metrics-scraper:v1.0.7" does not exist at hash "7801cfc6d5c072eb114355d369c830641064a246b5a774bcd668fac75ec728e9" in container runtime

	I1231 11:23:00.801005    7616 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\dashboard:v2.3.1 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\dashboard_v2.3.1

	I1231 11:23:00.801005    7616 docker.go:262] Removing image: docker.io/kubernetesui/dashboard:v2.3.1

	I1231 11:23:00.801005    7616 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\metrics-scraper:v1.0.7 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\metrics-scraper_v1.0.7

	I1231 11:23:00.801005    7616 docker.go:262] Removing image: docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1231 11:23:00.809015    7616 ssh_runner.go:195] Run: docker rmi docker.io/kubernetesui/dashboard:v2.3.1

	I1231 11:23:00.809015    7616 ssh_runner.go:195] Run: docker rmi docker.io/kubernetesui/metrics-scraper:v1.0.7

	W1231 11:23:00.820033    7616 image.go:190] authn lookup for k8s.gcr.io/etcd:3.4.3-0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:23:00.946973    7616 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\dashboard_v2.3.1

	I1231 11:23:00.947122    7616 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\metrics-scraper_v1.0.7

	I1231 11:23:00.962587    7616 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.7

	I1231 11:23:00.962587    7616 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.3.1

	I1231 11:23:00.973569    7616 ssh_runner.go:352] existence check for /var/lib/minikube/images/dashboard_v2.3.1: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.3.1: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/dashboard_v2.3.1': No such file or directory

	I1231 11:23:00.973569    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\dashboard_v2.3.1 --> /var/lib/minikube/images/dashboard_v2.3.1 (66936320 bytes)

	I1231 11:23:00.973569    7616 ssh_runner.go:352] existence check for /var/lib/minikube/images/metrics-scraper_v1.0.7: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.7: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/metrics-scraper_v1.0.7': No such file or directory

	I1231 11:23:00.974569    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\metrics-scraper_v1.0.7 --> /var/lib/minikube/images/metrics-scraper_v1.0.7 (15031296 bytes)

	I1231 11:23:00.989589    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/etcd:3.4.3-0

	I1231 11:23:02.826590    7616 docker.go:229] Loading image: /var/lib/minikube/images/metrics-scraper_v1.0.7

	I1231 11:23:02.826590    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/metrics-scraper_v1.0.7 | docker load"

	I1231 11:23:04.424859    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.7712486s)

	I1231 11:23:04.425860    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:23:04.433842    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.7932585s)

	I1231 11:23:04.433842    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:23:04.572852    6964 ssh_runner.go:235] Completed: systemctl --version: (1.930265s)

	I1231 11:23:04.590858    6964 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1231 11:23:04.687890    6964 ssh_runner.go:235] Completed: curl -sS -m 2 https://k8s.gcr.io/: (2.0582947s)

	I1231 11:23:04.700850    6964 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1231 11:23:04.737846    6964 cruntime.go:264] skipping containerd shutdown because we are bound to it

	I1231 11:23:04.747849    6964 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1231 11:23:04.775855    6964 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I1231 11:23:04.837847    6964 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1231 11:23:05.134848    6964 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1231 11:23:05.368862    6964 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1231 11:23:05.404844    6964 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1231 11:23:05.657813    6964 ssh_runner.go:195] Run: sudo systemctl start docker

	I1231 11:23:05.697806    6964 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1231 11:23:05.890816    6964 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1231 11:23:06.018810    6964 out.go:203] * Preparing Kubernetes v1.23.1 on Docker 20.10.12 ...

	I1231 11:23:06.027831    6964 cli_runner.go:133] Run: docker exec -t pause-20211231111903-1576 dig +short host.docker.internal

	I1231 11:23:07.972123    6964 cli_runner.go:186] Completed: docker exec -t pause-20211231111903-1576 dig +short host.docker.internal: (1.9441259s)

	I1231 11:23:07.972218    6964 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2

	I1231 11:23:07.982904    6964 ssh_runner.go:195] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I1231 11:23:07.999582    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:04.578916    4432 ssh_runner.go:235] Completed: sh -c "df -h /var | awk 'NR==2{print $5}'": (1.9293335s)

	I1231 11:23:04.582857    4432 fix.go:57] fixHost completed within 30.1596166s

	I1231 11:23:04.582857    4432 start.go:80] releasing machines lock for "kubernetes-upgrade-20211231111918-1576", held for 30.1596166s

	I1231 11:23:04.593866    4432 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211231111918-1576

	I1231 11:23:06.124126    4432 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211231111918-1576: (1.5302538s)

	I1231 11:23:06.126151    4432 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I1231 11:23:06.132135    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:23:06.135138    4432 ssh_runner.go:195] Run: systemctl --version

	I1231 11:23:06.144121    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:23:07.566599    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.4224712s)

	I1231 11:23:07.566599    4432 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56222 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\kubernetes-upgrade-20211231111918-1576\id_rsa Username:docker}

	I1231 11:23:07.567588    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.4354468s)

	I1231 11:23:07.567588    4432 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56222 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\kubernetes-upgrade-20211231111918-1576\id_rsa Username:docker}

	I1231 11:23:07.880379    4432 ssh_runner.go:235] Completed: curl -sS -m 2 https://k8s.gcr.io/: (1.7542211s)

	I1231 11:23:07.880379    4432 ssh_runner.go:235] Completed: systemctl --version: (1.7452338s)

	I1231 11:23:07.892351    4432 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1231 11:23:07.945974    4432 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1231 11:23:07.977902    4432 cruntime.go:264] skipping containerd shutdown because we are bound to it

	I1231 11:23:07.986920    4432 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1231 11:23:08.011531    4432 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I1231 11:23:08.063543    4432 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1231 11:23:08.242940    4432 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1231 11:23:08.397240    4432 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1231 11:23:08.437581    4432 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1231 11:23:08.608812    4432 ssh_runner.go:195] Run: sudo systemctl start docker

	I1231 11:23:08.645820    4432 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1231 11:23:08.752990    4432 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1231 11:23:09.405917    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.4062948s)

	I1231 11:23:09.410181    6964 out.go:176]   - kubelet.global-housekeeping-interval=60m

	I1231 11:23:08.854591    4432 out.go:203] * Preparing Kubernetes v1.23.2-rc.0 on Docker 20.10.12 ...

	I1231 11:23:08.861610    4432 cli_runner.go:133] Run: docker exec -t kubernetes-upgrade-20211231111918-1576 dig +short host.docker.internal

	I1231 11:23:06.057138    7616 ssh_runner.go:235] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/metrics-scraper_v1.0.7 | docker load": (3.2305342s)

	I1231 11:23:06.057138    7616 cache_images.go:315] Transferred and loaded C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\metrics-scraper_v1.0.7 from cache

	I1231 11:23:06.057138    7616 docker.go:229] Loading image: /var/lib/minikube/images/dashboard_v2.3.1

	I1231 11:23:06.057138    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/dashboard_v2.3.1 | docker load"

	I1231 11:23:10.742348    4432 cli_runner.go:186] Completed: docker exec -t kubernetes-upgrade-20211231111918-1576 dig +short host.docker.internal: (1.8807301s)

	I1231 11:23:10.742348    4432 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2

	I1231 11:23:10.752354    4432 ssh_runner.go:195] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I1231 11:23:10.764348    4432 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1231 11:23:10.799365    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:23:12.202482    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.4021162s)

	I1231 11:23:12.206490    4432 out.go:176]   - kubelet.global-housekeeping-interval=60m

	I1231 11:23:09.412189    6964 out.go:176]   - kubelet.housekeeping-interval=5m

	I1231 11:23:09.413195    6964 preload.go:132] Checking if preload exists for k8s version v1.23.1 and runtime docker

	I1231 11:23:09.418180    6964 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1231 11:23:09.508060    6964 docker.go:581] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.23.1

	k8s.gcr.io/kube-proxy:v1.23.1

	k8s.gcr.io/kube-scheduler:v1.23.1

	k8s.gcr.io/kube-controller-manager:v1.23.1

	k8s.gcr.io/etcd:3.5.1-0

	k8s.gcr.io/coredns/coredns:v1.8.6

	k8s.gcr.io/pause:3.6

	kubernetesui/dashboard:v2.3.1

	kubernetesui/metrics-scraper:v1.0.7

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1231 11:23:09.508125    6964 docker.go:512] Images already preloaded, skipping extraction

	I1231 11:23:09.518104    6964 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1231 11:23:09.616703    6964 docker.go:581] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.23.1

	k8s.gcr.io/kube-proxy:v1.23.1

	k8s.gcr.io/kube-scheduler:v1.23.1

	k8s.gcr.io/kube-controller-manager:v1.23.1

	k8s.gcr.io/etcd:3.5.1-0

	k8s.gcr.io/coredns/coredns:v1.8.6

	k8s.gcr.io/pause:3.6

	kubernetesui/dashboard:v2.3.1

	kubernetesui/metrics-scraper:v1.0.7

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1231 11:23:09.616703    6964 cache_images.go:84] Images are preloaded, skipping loading

	I1231 11:23:09.622723    6964 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1231 11:23:09.867055    6964 cni.go:93] Creating CNI manager for ""

	I1231 11:23:09.867055    6964 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:23:09.867055    6964 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1231 11:23:09.867055    6964 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.23.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:pause-20211231111903-1576 NodeName:pause-20211231111903-1576 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/mini

kube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I1231 11:23:09.868059    6964 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "pause-20211231111903-1576"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.23.1

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1231 11:23:09.868059    6964 kubeadm.go:788] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.23.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --global-housekeeping-interval=60m --hostname-override=pause-20211231111903-1576 --housekeeping-interval=5m --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.23.1 ClusterName:pause-20211231111903-1576 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1231 11:23:09.880044    6964 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.23.1

	I1231 11:23:09.903052    6964 binaries.go:44] Found k8s binaries, skipping transfer

	I1231 11:23:09.913056    6964 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1231 11:23:09.938065    6964 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (413 bytes)

	I1231 11:23:09.976054    6964 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1231 11:23:10.014055    6964 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2068 bytes)

	I1231 11:23:10.069066    6964 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I1231 11:23:10.079078    6964 certs.go:54] Setting up C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576 for IP: 192.168.49.2

	I1231 11:23:10.079078    6964 certs.go:182] skipping minikubeCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key

	I1231 11:23:10.080061    6964 certs.go:182] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key

	I1231 11:23:10.080061    6964 certs.go:298] skipping minikube-user signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\client.key

	I1231 11:23:10.081071    6964 certs.go:298] skipping minikube signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\apiserver.key.dd3b5fb2

	I1231 11:23:10.081071    6964 certs.go:298] skipping aggregator signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\proxy-client.key

	I1231 11:23:10.082059    6964 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576.pem (1338 bytes)

	W1231 11:23:10.083072    6964 certs.go:384] ignoring C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576_empty.pem, impossibly tiny 0 bytes

	I1231 11:23:10.083072    6964 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem (1679 bytes)

	I1231 11:23:10.083072    6964 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem (1082 bytes)

	I1231 11:23:10.083072    6964 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I1231 11:23:10.083072    6964 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I1231 11:23:10.084054    6964 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem (1708 bytes)

	I1231 11:23:10.086054    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1231 11:23:10.140058    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I1231 11:23:10.194065    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1231 11:23:10.242054    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I1231 11:23:10.295058    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1231 11:23:10.350968    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1231 11:23:10.407689    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1231 11:23:10.461121    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1231 11:23:10.523812    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem --> /usr/share/ca-certificates/15762.pem (1708 bytes)

	I1231 11:23:10.633956    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1231 11:23:10.699901    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576.pem --> /usr/share/ca-certificates/1576.pem (1338 bytes)

	I1231 11:23:10.751357    6964 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1231 11:23:10.801360    6964 ssh_runner.go:195] Run: openssl version

	I1231 11:23:10.826357    6964 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1231 11:23:10.863354    6964 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:23:10.875356    6964 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Dec 31 09:49 /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:23:10.883350    6964 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:23:10.906352    6964 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1231 11:23:10.934366    6964 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1576.pem && ln -fs /usr/share/ca-certificates/1576.pem /etc/ssl/certs/1576.pem"

	I1231 11:23:10.962615    6964 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1576.pem

	I1231 11:23:10.973620    6964 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Dec 31 10:02 /usr/share/ca-certificates/1576.pem

	I1231 11:23:10.981619    6964 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1576.pem

	I1231 11:23:11.001607    6964 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1576.pem /etc/ssl/certs/51391683.0"

	I1231 11:23:11.032600    6964 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15762.pem && ln -fs /usr/share/ca-certificates/15762.pem /etc/ssl/certs/15762.pem"

	I1231 11:23:11.064601    6964 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15762.pem

	I1231 11:23:11.075616    6964 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Dec 31 10:02 /usr/share/ca-certificates/15762.pem

	I1231 11:23:11.084614    6964 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15762.pem

	I1231 11:23:11.106618    6964 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/15762.pem /etc/ssl/certs/3ec20f2e.0"

	I1231 11:23:11.128629    6964 kubeadm.go:388] StartCluster: {Name:pause-20211231111903-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.1 ClusterName:pause-20211231111903-1576 Namespace:default APIServerName:minikubeCA APIServerNames:

[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.23.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPor

t:0 MountType:9p MountUID:docker}

	I1231 11:23:11.134634    6964 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1231 11:23:11.212449    6964 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1231 11:23:11.250890    6964 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1231 11:23:11.275889    6964 kubeadm.go:124] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1231 11:23:11.281898    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:12.746481    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.4645768s)

	I1231 11:23:12.748525    6964 kubeconfig.go:92] found "pause-20211231111903-1576" server: "https://127.0.0.1:56090"

	I1231 11:23:12.750499    6964 kapi.go:59] client config for pause-20211231111903-1576: &rest.Config{Host:"https://127.0.0.1:56090", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\pause-20211231111903-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\pause-20211231111903-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", CertData:[]uint8(nil), KeyData:[

]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:23:12.787484    6964 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1231 11:23:12.817500    6964 api_server.go:165] Checking apiserver status ...

	I1231 11:23:12.828489    6964 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1231 11:23:12.896484    6964 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1802/cgroup

	I1231 11:23:12.925512    6964 api_server.go:181] apiserver freezer: "20:freezer:/docker/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939/kubepods/burstable/pod61a858f6d0a505095df4f4e361b4fe99/0312af21019e02a88370acf826c837f9b955afc8956e8a5ae575837e9a5ffa52"

	I1231 11:23:12.934483    6964 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939/kubepods/burstable/pod61a858f6d0a505095df4f4e361b4fe99/0312af21019e02a88370acf826c837f9b955afc8956e8a5ae575837e9a5ffa52/freezer.state

	I1231 11:23:12.961490    6964 api_server.go:203] freezer state: "THAWED"

	I1231 11:23:12.961490    6964 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:56090/healthz ...

	I1231 11:23:12.208494    4432 out.go:176]   - kubelet.housekeeping-interval=5m

	I1231 11:23:12.209481    4432 preload.go:132] Checking if preload exists for k8s version v1.23.2-rc.0 and runtime docker

	I1231 11:23:12.215487    4432 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1231 11:23:12.334486    4432 docker.go:581] Got preloaded images: -- stdout --

	kubernetesui/dashboard:v2.3.1

	kubernetesui/metrics-scraper:v1.0.7

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/kube-apiserver:v1.16.0

	k8s.gcr.io/kube-proxy:v1.16.0

	k8s.gcr.io/kube-controller-manager:v1.16.0

	k8s.gcr.io/kube-scheduler:v1.16.0

	k8s.gcr.io/etcd:3.3.15-0

	k8s.gcr.io/coredns:1.6.2

	k8s.gcr.io/pause:3.1

	-- /stdout --

	I1231 11:23:12.334486    4432 docker.go:587] k8s.gcr.io/kube-apiserver:v1.23.2-rc.0 wasn't preloaded

	I1231 11:23:12.349494    4432 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1231 11:23:12.390492    4432 ssh_runner.go:195] Run: which lz4

	I1231 11:23:12.411509    4432 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I1231 11:23:12.424489    4432 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/preloaded.tar.lz4': No such file or directory

	I1231 11:23:12.424489    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.2-rc.0-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (528915498 bytes)

	I1231 11:23:14.981508    6964 api_server.go:266] https://127.0.0.1:56090/healthz returned 500:

	[+]ping ok

	[+]log ok

	[-]etcd failed: reason withheld

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/rbac/bootstrap-roles ok

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I1231 11:23:14.982503    6964 retry.go:31] will retry after 263.082536ms: https://127.0.0.1:56090/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[-]etcd failed: reason withheld

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/rbac/bootstrap-roles ok

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I1231 11:23:15.247494    6964 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:56090/healthz ...

	I1231 11:23:15.671552    6964 api_server.go:266] https://127.0.0.1:56090/healthz returned 200:

	ok

	I1231 11:23:15.710501    6964 system_pods.go:86] 6 kube-system pods found

	I1231 11:23:15.711507    6964 system_pods.go:89] "coredns-64897985d-rv9pb" [dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f] Running

	I1231 11:23:15.711507    6964 system_pods.go:89] "etcd-pause-20211231111903-1576" [72622213-821c-4658-9a71-8bd85c7ea55a] Running

	I1231 11:23:15.711507    6964 system_pods.go:89] "kube-apiserver-pause-20211231111903-1576" [0adf54cf-fd98-48c8-8c15-e202982b2f91] Running

	I1231 11:23:15.711507    6964 system_pods.go:89] "kube-controller-manager-pause-20211231111903-1576" [c8852535-307d-4b94-b74d-1fabe79c458d] Running

	I1231 11:23:15.711507    6964 system_pods.go:89] "kube-proxy-zqfxj" [1825a520-13e0-4474-a4e0-67a41d7c78c6] Running

	I1231 11:23:15.711507    6964 system_pods.go:89] "kube-scheduler-pause-20211231111903-1576" [1586a2e1-06da-42a9-8af1-4f8a13373bbc] Running

	I1231 11:23:15.715529    6964 api_server.go:140] control plane version: v1.23.1

	I1231 11:23:15.715529    6964 kubeadm.go:618] The running cluster does not require reconfiguration: 127.0.0.1

	I1231 11:23:15.715529    6964 kubeadm.go:390] StartCluster complete in 4.5868803s

	I1231 11:23:15.715529    6964 settings.go:142] acquiring lock: {Name:mk2f48f1c2db86c45c5c20d13312e07e9c171d09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:23:15.715529    6964 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 11:23:15.717543    6964 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:23:15.731506    6964 kapi.go:59] client config for pause-20211231111903-1576: &rest.Config{Host:"https://127.0.0.1:56090", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\pause-20211231111903-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\pause-20211231111903-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", CertData:[]uint8(nil), KeyData:[

]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:23:15.757491    6964 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "pause-20211231111903-1576" rescaled to 1

	I1231 11:23:15.757491    6964 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1231 11:23:15.758521    6964 start.go:206] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.23.1 ControlPlane:true Worker:true}

	I1231 11:23:15.758521    6964 addons.go:415] enableAddons start: toEnable=map[], additional=[]

	I1231 11:23:15.758521    6964 addons.go:65] Setting storage-provisioner=true in profile "pause-20211231111903-1576"

	I1231 11:23:15.758521    6964 addons.go:65] Setting default-storageclass=true in profile "pause-20211231111903-1576"

	I1231 11:23:15.758521    6964 config.go:176] Loaded profile config "pause-20211231111903-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.1

	I1231 11:23:15.762511    6964 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "pause-20211231111903-1576"

	I1231 11:23:15.762511    6964 out.go:176] * Verifying Kubernetes components...

	I1231 11:23:15.762511    6964 addons.go:153] Setting addon storage-provisioner=true in "pause-20211231111903-1576"

	W1231 11:23:15.762511    6964 addons.go:165] addon storage-provisioner should already be in state true

	I1231 11:23:15.765495    6964 host.go:66] Checking if "pause-20211231111903-1576" exists ...

	I1231 11:23:15.780519    6964 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1231 11:23:15.787553    6964 cli_runner.go:133] Run: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}

	I1231 11:23:15.787553    6964 cli_runner.go:133] Run: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}

	I1231 11:23:17.351691    6964 cli_runner.go:186] Completed: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}: (1.5641321s)

	I1231 11:23:17.353684    6964 kapi.go:59] client config for pause-20211231111903-1576: &rest.Config{Host:"https://127.0.0.1:56090", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\pause-20211231111903-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\pause-20211231111903-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", CertData:[]uint8(nil), KeyData:[

]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:23:17.360705    6964 cli_runner.go:186] Completed: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}: (1.5731458s)

	I1231 11:23:17.364676    6964 out.go:176]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1231 11:23:17.365697    6964 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1231 11:23:17.365697    6964 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1231 11:23:17.375679    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:17.980465    6964 addons.go:153] Setting addon default-storageclass=true in "pause-20211231111903-1576"

	W1231 11:23:17.980465    6964 addons.go:165] addon default-storageclass should already be in state true

	I1231 11:23:17.980465    6964 host.go:66] Checking if "pause-20211231111903-1576" exists ...

	I1231 11:23:17.996457    6964 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (2.2389564s)

	I1231 11:23:17.996457    6964 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (2.2159283s)

	I1231 11:23:17.996457    6964 start.go:753] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I1231 11:23:18.005446    6964 cli_runner.go:133] Run: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}

	I1231 11:23:18.008617    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:18.280443    7616 ssh_runner.go:235] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/dashboard_v2.3.1 | docker load": (12.2232539s)

	I1231 11:23:18.280443    7616 cache_images.go:315] Transferred and loaded C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\dashboard_v2.3.1 from cache

	I1231 11:23:18.280443    7616 cache_images.go:123] Successfully loaded all cached images

	I1231 11:23:18.280443    7616 cache_images.go:92] LoadImages completed in 21.0602489s

	I1231 11:23:18.287447    7616 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1231 11:23:18.434444    7616 cni.go:93] Creating CNI manager for ""

	I1231 11:23:18.434444    7616 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:23:18.435445    7616 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1231 11:23:18.435445    7616 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:172.17.0.2 APIServerPort:8443 KubernetesVersion:v1.18.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:stopped-upgrade-20211231111352-1576 NodeName:stopped-upgrade-20211231111352-1576 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "172.17.0.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:172.17.0.2 CgroupDriver:cgroupfs ClientCAFile

:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I1231 11:23:18.435445    7616 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 172.17.0.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "stopped-upgrade-20211231111352-1576"

	  kubeletExtraArgs:

	    node-ip: 172.17.0.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "172.17.0.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.18.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1231 11:23:18.435445    7616 kubeadm.go:788] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.18.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=stopped-upgrade-20211231111352-1576 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=172.17.0.2

	[Install]

	 config:

	{KubernetesVersion:v1.18.0 ClusterName:stopped-upgrade-20211231111352-1576 Namespace: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1231 11:23:18.445448    7616 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.0

	I1231 11:23:18.472473    7616 binaries.go:44] Found k8s binaries, skipping transfer

	I1231 11:23:18.482443    7616 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1231 11:23:18.508451    7616 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (359 bytes)

	I1231 11:23:18.553454    7616 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1231 11:23:18.601455    7616 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2072 bytes)

	I1231 11:23:18.659447    7616 ssh_runner.go:195] Run: grep 172.17.0.2	control-plane.minikube.internal$ /etc/hosts

	I1231 11:23:18.675519    7616 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "172.17.0.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1231 11:23:18.711460    7616 certs.go:54] Setting up C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576 for IP: 172.17.0.2

	I1231 11:23:18.711460    7616 certs.go:182] skipping minikubeCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key

	I1231 11:23:18.712460    7616 certs.go:182] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key

	I1231 11:23:18.712460    7616 certs.go:298] skipping minikube-user signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\client.key

	I1231 11:23:18.713453    7616 certs.go:302] generating minikube signed cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.key.7b749c5f

	I1231 11:23:18.713453    7616 crypto.go:68] Generating cert C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.crt.7b749c5f with IP's: [172.17.0.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I1231 11:23:19.014457    7616 crypto.go:156] Writing cert to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.crt.7b749c5f ...

	I1231 11:23:19.015443    7616 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.crt.7b749c5f: {Name:mk97434e7038d9c1caf6735fafaca907dac7728a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:23:19.016451    7616 crypto.go:164] Writing key to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.key.7b749c5f ...

	I1231 11:23:19.016451    7616 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.key.7b749c5f: {Name:mk7cf6897cfa3042eb783d255ce83af3588d365b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:23:19.018451    7616 certs.go:320] copying C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.crt.7b749c5f -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.crt

	I1231 11:23:19.035493    7616 certs.go:324] copying C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.key.7b749c5f -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.key

	I1231 11:23:19.037451    7616 certs.go:298] skipping aggregator signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\proxy-client.key

	I1231 11:23:19.039451    7616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576.pem (1338 bytes)

	W1231 11:23:19.040452    7616 certs.go:384] ignoring C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576_empty.pem, impossibly tiny 0 bytes

	I1231 11:23:19.040452    7616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem (1679 bytes)

	I1231 11:23:19.040452    7616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem (1082 bytes)

	I1231 11:23:19.041450    7616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I1231 11:23:19.041450    7616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I1231 11:23:19.042456    7616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem (1708 bytes)

	I1231 11:23:19.046453    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1231 11:23:19.108448    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1231 11:23:19.167474    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1231 11:23:19.228451    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I1231 11:23:19.294447    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1231 11:23:19.356456    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1231 11:23:19.422446    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1231 11:23:19.481462    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1231 11:23:19.539456    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem --> /usr/share/ca-certificates/15762.pem (1708 bytes)

	I1231 11:23:19.601482    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1231 11:23:19.676454    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576.pem --> /usr/share/ca-certificates/1576.pem (1338 bytes)

	I1231 11:23:19.739494    7616 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I1231 11:23:19.816490    7616 ssh_runner.go:195] Run: openssl version

	I1231 11:23:19.847475    7616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1231 11:23:19.897457    7616 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:23:19.908452    7616 certs.go:431] hashing: -rwxr-xr-x 1 root root 1111 Dec 31 09:49 /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:23:19.918447    7616 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:23:19.949442    7616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1231 11:23:19.993483    7616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1576.pem && ln -fs /usr/share/ca-certificates/1576.pem /etc/ssl/certs/1576.pem"

	I1231 11:23:20.031467    7616 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1576.pem

	I1231 11:23:20.048448    7616 certs.go:431] hashing: -rwxr-xr-x 1 root root 1338 Dec 31 10:02 /usr/share/ca-certificates/1576.pem

	I1231 11:23:20.064471    7616 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1576.pem

	I1231 11:23:20.097451    7616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1576.pem /etc/ssl/certs/51391683.0"

	I1231 11:23:19.012446    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.6367608s)

	I1231 11:23:19.012446    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:23:19.211452    6964 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1231 11:23:19.784451    6964 cli_runner.go:186] Completed: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}: (1.7789972s)

	I1231 11:23:19.784451    6964 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml

	I1231 11:23:19.784451    6964 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1231 11:23:19.793464    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.784839s)

	I1231 11:23:19.793464    6964 node_ready.go:35] waiting up to 6m0s for node "pause-20211231111903-1576" to be "Ready" ...

	I1231 11:23:19.796489    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:19.807478    6964 node_ready.go:49] node "pause-20211231111903-1576" has status "Ready":"True"

	I1231 11:23:19.807478    6964 node_ready.go:38] duration metric: took 14.0143ms waiting for node "pause-20211231111903-1576" to be "Ready" ...

	I1231 11:23:19.807478    6964 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1231 11:23:19.848461    6964 pod_ready.go:78] waiting up to 6m0s for pod "coredns-64897985d-rv9pb" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:19.886466    6964 pod_ready.go:92] pod "coredns-64897985d-rv9pb" in "kube-system" namespace has status "Ready":"True"

	I1231 11:23:19.886466    6964 pod_ready.go:81] duration metric: took 38.0053ms waiting for pod "coredns-64897985d-rv9pb" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:19.886466    6964 pod_ready.go:78] waiting up to 6m0s for pod "etcd-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:19.973462    6964 pod_ready.go:92] pod "etcd-pause-20211231111903-1576" in "kube-system" namespace has status "Ready":"True"

	I1231 11:23:19.973462    6964 pod_ready.go:81] duration metric: took 86.995ms waiting for pod "etcd-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:19.973462    6964 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:19.991470    6964 pod_ready.go:92] pod "kube-apiserver-pause-20211231111903-1576" in "kube-system" namespace has status "Ready":"True"

	I1231 11:23:19.991470    6964 pod_ready.go:81] duration metric: took 18.0081ms waiting for pod "kube-apiserver-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:19.991470    6964 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:20.052446    6964 pod_ready.go:92] pod "kube-controller-manager-pause-20211231111903-1576" in "kube-system" namespace has status "Ready":"True"

	I1231 11:23:20.052446    6964 pod_ready.go:81] duration metric: took 60.9757ms waiting for pod "kube-controller-manager-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:20.052446    6964 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-zqfxj" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:20.208458    6964 pod_ready.go:92] pod "kube-proxy-zqfxj" in "kube-system" namespace has status "Ready":"True"

	I1231 11:23:20.208458    6964 pod_ready.go:81] duration metric: took 154.9932ms waiting for pod "kube-proxy-zqfxj" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:20.208458    6964 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:20.603472    6964 pod_ready.go:92] pod "kube-scheduler-pause-20211231111903-1576" in "kube-system" namespace has status "Ready":"True"

	I1231 11:23:20.603472    6964 pod_ready.go:81] duration metric: took 394.0264ms waiting for pod "kube-scheduler-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:20.603472    6964 pod_ready.go:38] duration metric: took 795.9907ms for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1231 11:23:20.603472    6964 api_server.go:51] waiting for apiserver process to appear ...

	I1231 11:23:20.618452    6964 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1231 11:23:20.674484    6964 api_server.go:71] duration metric: took 4.9159426s to wait for apiserver process to appear ...

	I1231 11:23:20.674484    6964 api_server.go:87] waiting for apiserver healthz status ...

	I1231 11:23:20.674484    6964 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:56090/healthz ...

	I1231 11:23:20.700486    6964 api_server.go:266] https://127.0.0.1:56090/healthz returned 200:

	ok

	I1231 11:23:20.707461    6964 api_server.go:140] control plane version: v1.23.1

	I1231 11:23:20.707461    6964 api_server.go:130] duration metric: took 32.9765ms to wait for apiserver health ...

	I1231 11:23:20.707461    6964 system_pods.go:43] waiting for kube-system pods to appear ...

	I1231 11:23:20.810456    6964 system_pods.go:59] 7 kube-system pods found

	I1231 11:23:20.810456    6964 system_pods.go:61] "coredns-64897985d-rv9pb" [dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f] Running

	I1231 11:23:20.810456    6964 system_pods.go:61] "etcd-pause-20211231111903-1576" [72622213-821c-4658-9a71-8bd85c7ea55a] Running

	I1231 11:23:20.810456    6964 system_pods.go:61] "kube-apiserver-pause-20211231111903-1576" [0adf54cf-fd98-48c8-8c15-e202982b2f91] Running

	I1231 11:23:20.810456    6964 system_pods.go:61] "kube-controller-manager-pause-20211231111903-1576" [c8852535-307d-4b94-b74d-1fabe79c458d] Running

	I1231 11:23:20.810456    6964 system_pods.go:61] "kube-proxy-zqfxj" [1825a520-13e0-4474-a4e0-67a41d7c78c6] Running

	I1231 11:23:20.810456    6964 system_pods.go:61] "kube-scheduler-pause-20211231111903-1576" [1586a2e1-06da-42a9-8af1-4f8a13373bbc] Running

	I1231 11:23:20.810456    6964 system_pods.go:61] "storage-provisioner" [b045595f-407a-448d-b07b-49071722a847] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I1231 11:23:20.810456    6964 system_pods.go:74] duration metric: took 102.9941ms to wait for pod list to return data ...

	I1231 11:23:20.810456    6964 default_sa.go:34] waiting for default service account to be created ...

	I1231 11:23:21.003664    6964 default_sa.go:45] found service account: "default"

	I1231 11:23:21.003664    6964 default_sa.go:55] duration metric: took 193.2079ms for default service account to be created ...

	I1231 11:23:21.003664    6964 system_pods.go:116] waiting for k8s-apps to be running ...

	I1231 11:23:21.207650    6964 system_pods.go:86] 7 kube-system pods found

	I1231 11:23:21.207650    6964 system_pods.go:89] "coredns-64897985d-rv9pb" [dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f] Running

	I1231 11:23:21.207650    6964 system_pods.go:89] "etcd-pause-20211231111903-1576" [72622213-821c-4658-9a71-8bd85c7ea55a] Running

	I1231 11:23:21.207650    6964 system_pods.go:89] "kube-apiserver-pause-20211231111903-1576" [0adf54cf-fd98-48c8-8c15-e202982b2f91] Running

	I1231 11:23:21.207650    6964 system_pods.go:89] "kube-controller-manager-pause-20211231111903-1576" [c8852535-307d-4b94-b74d-1fabe79c458d] Running

	I1231 11:23:21.207650    6964 system_pods.go:89] "kube-proxy-zqfxj" [1825a520-13e0-4474-a4e0-67a41d7c78c6] Running

	I1231 11:23:21.207650    6964 system_pods.go:89] "kube-scheduler-pause-20211231111903-1576" [1586a2e1-06da-42a9-8af1-4f8a13373bbc] Running

	I1231 11:23:21.207650    6964 system_pods.go:89] "storage-provisioner" [b045595f-407a-448d-b07b-49071722a847] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I1231 11:23:21.207650    6964 system_pods.go:126] duration metric: took 203.9843ms to wait for k8s-apps to be running ...

	I1231 11:23:21.207650    6964 system_svc.go:44] waiting for kubelet service to be running ....

	I1231 11:23:21.217655    6964 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1231 11:23:21.250673    6964 system_svc.go:56] duration metric: took 43.023ms WaitForService to wait for kubelet.

	I1231 11:23:21.250673    6964 kubeadm.go:542] duration metric: took 5.4921284s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I1231 11:23:21.250673    6964 node_conditions.go:102] verifying NodePressure condition ...

	I1231 11:23:21.918047    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (2.1205768s)

	I1231 11:23:21.918047    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:23:22.065061    6964 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1231 11:23:24.004056    6964 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I1231 11:23:24.004056    6964 node_conditions.go:123] node cpu capacity is 16

	I1231 11:23:24.004056    6964 node_conditions.go:105] duration metric: took 2.7533722s to run NodePressure ...

	I1231 11:23:24.004056    6964 start.go:211] waiting for startup goroutines ...

	I1231 11:23:24.210055    6964 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.1449851s)

	I1231 11:23:24.297064    6964 out.go:176] * Enabled addons: storage-provisioner, default-storageclass

	I1231 11:23:24.297064    6964 addons.go:417] enableAddons completed in 8.5385068s

	I1231 11:23:24.496054    6964 start.go:493] kubectl: 1.18.2, cluster: 1.23.1 (minor skew: 5)

	I1231 11:23:24.603053    6964 out.go:176] 

	W1231 11:23:24.603053    6964 out.go:241] ! C:\ProgramData\chocolatey\bin\kubectl.exe is version 1.18.2, which may have incompatibilites with Kubernetes 1.23.1.

	I1231 11:23:24.698048    6964 out.go:176]   - Want kubectl v1.23.1? Try 'minikube kubectl -- get pods -A'

	I1231 11:23:24.882061    6964 out.go:176] * Done! kubectl is now configured to use "pause-20211231111903-1576" cluster and "default" namespace by default

	I1231 11:23:20.130496    7616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15762.pem && ln -fs /usr/share/ca-certificates/15762.pem /etc/ssl/certs/15762.pem"

	I1231 11:23:20.171461    7616 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15762.pem

	I1231 11:23:20.183484    7616 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Dec 31 10:02 /usr/share/ca-certificates/15762.pem

	I1231 11:23:20.193458    7616 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15762.pem

	I1231 11:23:20.223468    7616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/15762.pem /etc/ssl/certs/3ec20f2e.0"

	I1231 11:23:20.250485    7616 kubeadm.go:388] StartCluster: {Name:stopped-upgrade-20211231111352-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.18.0 ClusterName:stopped-upgrade-20211231111352-1576 Namespace: APIServerName:minikubeCA APIServ

erNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name:m01 IP:172.17.0.2 Port:8443 KubernetesVersion:v1.18.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[] StartHostTimeout:0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString: Mount9PVersion: MountGID: MountIP: MountMSize:0 MountOptions:[] MountPort:0 MountType: MountUID:}

	I1231 11:23:20.259468    7616 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1231 11:23:20.394442    7616 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1231 11:23:20.433451    7616 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1231 11:23:20.459465    7616 kubeadm.go:124] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1231 11:23:20.470456    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:23:22.119054    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.648591s)

	I1231 11:23:22.121046    7616 kubeconfig.go:116] verify returned: extract IP: "stopped-upgrade-20211231111352-1576" does not appear in C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 11:23:22.122066    7616 kubeconfig.go:127] "stopped-upgrade-20211231111352-1576" context is missing from C:\Users\jenkins.minikube7\minikube-integration\kubeconfig - will repair!

	I1231 11:23:22.123063    7616 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:23:22.142056    7616 kapi.go:59] client config for stopped-upgrade-20211231111352-1576: &rest.Config{Host:"https://127.0.0.1:56201", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\stopped-upgrade-20211231111352-1576/client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\stopped-upgrade-20211231111352-1576/client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube/ca.crt", CertD

ata:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:23:22.175054    7616 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1231 11:23:22.204065    7616 kubeadm.go:593] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml	2021-12-31 11:18:24.548623600 +0000

	+++ /var/tmp/minikube/kubeadm.yaml.new	2021-12-31 11:23:18.608623600 +0000

	@@ -23,16 +23,52 @@

	   certSANs: ["127.0.0.1", "localhost", "172.17.0.2"]

	   extraArgs:

	     enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	+controllerManager:

	+  extraArgs:

	+    allocate-node-cidrs: "true"

	+    leader-elect: "false"

	+scheduler:

	+  extraArgs:

	+    leader-elect: "false"

	 certificatesDir: /var/lib/minikube/certs

	 clusterName: mk

	-controlPlaneEndpoint: 172.17.0.2:8443

	+controlPlaneEndpoint: control-plane.minikube.internal:8443

	 dns:

	   type: CoreDNS

	 etcd:

	   local:

	     dataDir: /var/lib/minikube/etcd

	+    extraArgs:

	+      proxy-refresh-interval: "70000"

	 kubernetesVersion: v1.18.0

	 networking:

	   dnsDomain: cluster.local

	   podSubnet: "10.244.0.0/16"

	   serviceSubnet: 10.96.0.0/12

	+---

	+apiVersion: kubelet.config.k8s.io/v1beta1

	+kind: KubeletConfiguration

	+authentication:

	+  x509:

	+    clientCAFile: /var/lib/minikube/certs/ca.crt

	+cgroupDriver: cgroupfs

	+clusterDomain: "cluster.local"

	+# disable disk resource management by default

	+imageGCHighThresholdPercent: 100

	+evictionHard:

	+  nodefs.available: "0%!"(MISSING)

	+  nodefs.inodesFree: "0%!"(MISSING)

	+  imagefs.available: "0%!"(MISSING)

	+failSwapOn: false

	+staticPodPath: /etc/kubernetes/manifests

	+---

	+apiVersion: kubeproxy.config.k8s.io/v1alpha1

	+kind: KubeProxyConfiguration

	+clusterCIDR: "10.244.0.0/16"

	+metricsBindAddress: 0.0.0.0:10249

	+conntrack:

	+  maxPerCore: 0

	+# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	+  tcpEstablishedTimeout: 0s

	+# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	+  tcpCloseWaitTimeout: 0s

	-- /stdout --

	I1231 11:23:22.204065    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"

	I1231 11:23:27.733095    7616 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force": (5.5290069s)

	I1231 11:23:27.743068    7616 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1231 11:23:27.784084    7616 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1231 11:23:27.809077    7616 kubeadm.go:218] ignoring SystemVerification for kubeadm because of docker driver

	I1231 11:23:27.820067    7616 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1231 11:23:27.846124    7616 kubeadm.go:149] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1231 11:23:27.846124    7616 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1231 11:23:44.221953    4432 docker.go:546] Took 31.819325 seconds to copy over tarball

	I1231 11:23:44.229388    4432 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I1231 11:24:01.588393    4432 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (17.3589322s)

	I1231 11:24:01.588393    4432 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I1231 11:24:01.736614    4432 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1231 11:24:01.759506    4432 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (3460 bytes)

	I1231 11:24:01.812002    4432 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1231 11:24:01.991788    4432 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1231 11:24:13.041790    7616 out.go:203]   - Generating certificates and keys ...

	I1231 11:24:13.048804    7616 out.go:203]   - Booting up control plane ...

	I1231 11:24:11.404875    4432 ssh_runner.go:235] Completed: sudo systemctl restart docker: (9.4129429s)

	I1231 11:24:11.417223    4432 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1231 11:24:11.507608    4432 docker.go:581] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.23.2-rc.0

	k8s.gcr.io/kube-controller-manager:v1.23.2-rc.0

	k8s.gcr.io/kube-scheduler:v1.23.2-rc.0

	k8s.gcr.io/kube-proxy:v1.23.2-rc.0

	k8s.gcr.io/etcd:3.5.1-0

	k8s.gcr.io/coredns/coredns:v1.8.6

	k8s.gcr.io/pause:3.6

	kubernetesui/dashboard:v2.3.1

	kubernetesui/metrics-scraper:v1.0.7

	gcr.io/k8s-minikube/storage-provisioner:v5

	<none>:<none>

	<none>:<none>

	<none>:<none>

	<none>:<none>

	<none>:<none>

	k8s.gcr.io/coredns:1.6.2

	<none>:<none>

	-- /stdout --

	I1231 11:24:11.507608    4432 cache_images.go:84] Images are preloaded, skipping loading

	I1231 11:24:11.512604    4432 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1231 11:24:11.809780    4432 cni.go:93] Creating CNI manager for ""

	I1231 11:24:11.809780    4432 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:24:11.809780    4432 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1231 11:24:11.809780    4432 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.58.2 APIServerPort:8443 KubernetesVersion:v1.23.2-rc.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kubernetes-upgrade-20211231111918-1576 NodeName:kubernetes-upgrade-20211231111918-1576 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.58.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.58.2 CgroupDriver:cgro

upfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I1231 11:24:11.809780    4432 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.58.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "kubernetes-upgrade-20211231111918-1576"

	  kubeletExtraArgs:

	    node-ip: 192.168.58.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.58.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.23.2-rc.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1231 11:24:11.809780    4432 kubeadm.go:788] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.23.2-rc.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --global-housekeeping-interval=60m --hostname-override=kubernetes-upgrade-20211231111918-1576 --housekeeping-interval=5m --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.58.2

	[Install]

	 config:

	{KubernetesVersion:v1.23.2-rc.0 ClusterName:kubernetes-upgrade-20211231111918-1576 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1231 11:24:11.818781    4432 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.23.2-rc.0

	I1231 11:24:11.843783    4432 binaries.go:44] Found k8s binaries, skipping transfer

	I1231 11:24:11.854776    4432 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1231 11:24:11.883778    4432 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (431 bytes)

	I1231 11:24:11.922790    4432 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)

	I1231 11:24:11.969805    4432 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2086 bytes)

	I1231 11:24:12.020780    4432 ssh_runner.go:195] Run: grep 192.168.58.2	control-plane.minikube.internal$ /etc/hosts

	I1231 11:24:12.032806    4432 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.58.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1231 11:24:12.075826    4432 certs.go:54] Setting up C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576 for IP: 192.168.58.2

	I1231 11:24:12.076777    4432 certs.go:182] skipping minikubeCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key

	I1231 11:24:12.076777    4432 certs.go:182] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key

	I1231 11:24:12.077789    4432 certs.go:298] skipping minikube-user signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\client.key

	I1231 11:24:12.077789    4432 certs.go:298] skipping minikube signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\apiserver.key.cee25041

	I1231 11:24:12.077789    4432 certs.go:298] skipping aggregator signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\proxy-client.key

	I1231 11:24:12.079784    4432 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576.pem (1338 bytes)

	W1231 11:24:12.079784    4432 certs.go:384] ignoring C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576_empty.pem, impossibly tiny 0 bytes

	I1231 11:24:12.079784    4432 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem (1679 bytes)

	I1231 11:24:12.079784    4432 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem (1082 bytes)

	I1231 11:24:12.080783    4432 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I1231 11:24:12.080783    4432 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I1231 11:24:12.080783    4432 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem (1708 bytes)

	I1231 11:24:12.083805    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1231 11:24:12.137990    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1231 11:24:12.210073    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1231 11:24:12.282416    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1231 11:24:12.339324    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1231 11:24:12.398470    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1231 11:24:12.464231    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1231 11:24:12.513997    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1231 11:24:12.576745    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1231 11:24:12.630282    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576.pem --> /usr/share/ca-certificates/1576.pem (1338 bytes)

	I1231 11:24:12.689233    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem --> /usr/share/ca-certificates/15762.pem (1708 bytes)

	I1231 11:24:12.749451    4432 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1231 11:24:12.799669    4432 ssh_runner.go:195] Run: openssl version

	I1231 11:24:12.824713    4432 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1231 11:24:12.867822    4432 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:24:12.881692    4432 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Dec 31 09:49 /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:24:12.888680    4432 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:24:12.909685    4432 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1231 11:24:12.956838    4432 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1576.pem && ln -fs /usr/share/ca-certificates/1576.pem /etc/ssl/certs/1576.pem"

	I1231 11:24:12.991792    4432 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1576.pem

	I1231 11:24:13.001795    4432 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Dec 31 10:02 /usr/share/ca-certificates/1576.pem

	I1231 11:24:13.009802    4432 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1576.pem

	I1231 11:24:13.044787    4432 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1576.pem /etc/ssl/certs/51391683.0"

	I1231 11:24:13.086793    4432 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15762.pem && ln -fs /usr/share/ca-certificates/15762.pem /etc/ssl/certs/15762.pem"

	I1231 11:24:13.128042    4432 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15762.pem

	I1231 11:24:13.145794    4432 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Dec 31 10:02 /usr/share/ca-certificates/15762.pem

	I1231 11:24:13.163809    4432 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15762.pem

	I1231 11:24:13.183754    4432 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/15762.pem /etc/ssl/certs/3ec20f2e.0"

	I1231 11:24:13.205767    4432 kubeadm.go:388] StartCluster: {Name:kubernetes-upgrade-20211231111918-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.2-rc.0 ClusterName:kubernetes-upgrade-20211231111918-1576 Namespace:default APIServer

Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.23.2-rc.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions

:[] MountPort:0 MountType:9p MountUID:docker}

	I1231 11:24:13.212768    4432 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1231 11:24:13.311179    4432 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1231 11:24:13.354529    4432 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1231 11:24:13.380505    4432 kubeadm.go:124] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1231 11:24:13.388505    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:24:13.060822    7616 out.go:203]   - Configuring RBAC rules ...

	I1231 11:24:13.066809    7616 cni.go:93] Creating CNI manager for ""

	I1231 11:24:13.067804    7616 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:24:13.067804    7616 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1231 11:24:13.080819    7616 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.0/kubectl label nodes minikube.k8s.io/version=v1.24.0 minikube.k8s.io/commit=a81813405fc4902e1caabd8d69223ec230d201fb minikube.k8s.io/name=stopped-upgrade-20211231111352-1576 minikube.k8s.io/updated_at=2021_12_31T11_24_13_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I1231 11:24:13.080819    7616 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1231 11:24:13.160792    7616 ops.go:34] apiserver oom_adj: -16

	I1231 11:24:14.541353    7616 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.18.0/kubectl label nodes minikube.k8s.io/version=v1.24.0 minikube.k8s.io/commit=a81813405fc4902e1caabd8d69223ec230d201fb minikube.k8s.io/name=stopped-upgrade-20211231111352-1576 minikube.k8s.io/updated_at=2021_12_31T11_24_13_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig: (1.4605281s)

	I1231 11:24:14.541681    7616 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.18.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig: (1.4605281s)

	I1231 11:24:14.541681    7616 kubeadm.go:864] duration metric: took 1.4738703s to wait for elevateKubeSystemPrivileges.

	I1231 11:24:14.541829    7616 kubeadm.go:390] StartCluster complete in 54.2911154s

	I1231 11:24:14.541829    7616 settings.go:142] acquiring lock: {Name:mk2f48f1c2db86c45c5c20d13312e07e9c171d09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:24:14.542128    7616 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 11:24:14.544939    7616 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:24:14.566126    7616 kapi.go:59] client config for stopped-upgrade-20211231111352-1576: &rest.Config{Host:"https://127.0.0.1:56201", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\stopped-upgrade-20211231111352-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\stopped-upgrade-20211231111352-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", Ce

rtData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:24:15.346977    7616 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "stopped-upgrade-20211231111352-1576" rescaled to 1

	I1231 11:24:15.346977    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1231 11:24:15.348032    7616 start.go:206] Will wait 6m0s for node &{Name:m01 IP:172.17.0.2 Port:8443 KubernetesVersion:v1.18.0 ControlPlane:true Worker:true}

	I1231 11:24:15.348032    7616 addons.go:415] enableAddons start: toEnable=map[default-storageclass:true storage-provisioner:true], additional=[]

	I1231 11:24:15.352034    7616 out.go:176] * Verifying Kubernetes components...

	I1231 11:24:15.348997    7616 addons.go:65] Setting storage-provisioner=true in profile "stopped-upgrade-20211231111352-1576"

	I1231 11:24:15.352034    7616 addons.go:153] Setting addon storage-provisioner=true in "stopped-upgrade-20211231111352-1576"

	I1231 11:24:15.348997    7616 addons.go:65] Setting default-storageclass=true in profile "stopped-upgrade-20211231111352-1576"

	I1231 11:24:15.348997    7616 config.go:176] Loaded profile config "stopped-upgrade-20211231111352-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	W1231 11:24:15.352991    7616 addons.go:165] addon storage-provisioner should already be in state true

	I1231 11:24:15.352991    7616 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "stopped-upgrade-20211231111352-1576"

	I1231 11:24:15.352991    7616 host.go:66] Checking if "stopped-upgrade-20211231111352-1576" exists ...

	I1231 11:24:15.368992    7616 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1231 11:24:15.376983    7616 cli_runner.go:133] Run: docker container inspect stopped-upgrade-20211231111352-1576 --format={{.State.Status}}

	I1231 11:24:15.380984    7616 cli_runner.go:133] Run: docker container inspect stopped-upgrade-20211231111352-1576 --format={{.State.Status}}

	I1231 11:24:16.447134    7616 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (1.1001519s)

	I1231 11:24:16.447134    7616 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (1.0771511s)

	I1231 11:24:16.447134    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.2 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1231 11:24:16.467123    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:24:17.087355    7616 cli_runner.go:186] Completed: docker container inspect stopped-upgrade-20211231111352-1576 --format={{.State.Status}}: (1.7103642s)

	I1231 11:24:17.090364    7616 kapi.go:59] client config for stopped-upgrade-20211231111352-1576: &rest.Config{Host:"https://127.0.0.1:56201", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\stopped-upgrade-20211231111352-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\stopped-upgrade-20211231111352-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", Ce

rtData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:24:17.123334    7616 cli_runner.go:186] Completed: docker container inspect stopped-upgrade-20211231111352-1576 --format={{.State.Status}}: (1.7423432s)

	* 

	* ==> Docker <==

	* -- Logs begin at Fri 2021-12-31 11:20:35 UTC, end at Fri 2021-12-31 11:24:25 UTC. --

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.702861200Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.702894300Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.714203600Z" level=info msg="parsed scheme: \"unix\"" module=grpc

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.714406600Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.714536100Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.714654400Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.744941600Z" level=info msg="[graphdriver] using prior storage driver: overlay2"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.770369300Z" level=warning msg="Your kernel does not support cgroup blkio weight"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.770484100Z" level=warning msg="Your kernel does not support cgroup blkio weight_device"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.770502200Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_bps_device"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.770509400Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_bps_device"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.770517400Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_iops_device"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.770523800Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_iops_device"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.771092500Z" level=info msg="Loading containers: start."

	Dec 31 11:21:03 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:03.343501800Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"

	Dec 31 11:21:04 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:04.711136700Z" level=info msg="Loading containers: done."

	Dec 31 11:21:04 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:04.771651500Z" level=info msg="Docker daemon" commit=459d0df graphdriver(s)=overlay2 version=20.10.12

	Dec 31 11:21:04 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:04.772097300Z" level=info msg="Daemon has completed initialization"

	Dec 31 11:21:04 pause-20211231111903-1576 systemd[1]: Started Docker Application Container Engine.

	Dec 31 11:21:04 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:04.839079400Z" level=info msg="API listen on [::]:2376"

	Dec 31 11:21:04 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:04.849476400Z" level=info msg="API listen on /var/run/docker.sock"

	Dec 31 11:23:50 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:23:50.532092600Z" level=info msg="ignoring event" container=f058545bad9de7df5c68cd5cf5aba8846942577907b1f229f21e7676a8736b2e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Dec 31 11:23:59 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:23:59.064393700Z" level=error msg="Handler for POST /v1.41/containers/0843676a5aa7/pause returned error: Cannot pause container 0843676a5aa7b1cbebd6a16a57ca6a1278c3da65fd3a4b46465cc4df734482ac: OCI runtime pause failed: unable to freeze: unknown"

	Dec 31 11:24:07 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:24:07.028712900Z" level=error msg="Handler for GET /v1.41/containers/f058545bad9de7df5c68cd5cf5aba8846942577907b1f229f21e7676a8736b2e/json returned error: write unix /var/run/docker.sock->@: write: broken pipe"

	Dec 31 11:24:07 pause-20211231111903-1576 dockerd[473]: http: superfluous response.WriteHeader call from github.com/docker/docker/api/server/httputils.WriteJSON (httputils_write_json.go:11)

	* 

	* ==> container status <==

	* time="2021-12-31T11:24:27Z" level=fatal msg="connect: connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"

	CONTAINER ID   IMAGE                  COMMAND                  CREATED              STATUS                        PORTS     NAMES

	f058545bad9d   6e38f40d628d           "/storage-provisioner"   About a minute ago   Exited (255) 37 seconds ago             k8s_storage-provisioner_storage-provisioner_kube-system_b045595f-407a-448d-b07b-49071722a847_0

	170e6b6065b2   k8s.gcr.io/pause:3.6   "/pause"                 About a minute ago   Up About a minute (Paused)              k8s_POD_storage-provisioner_kube-system_b045595f-407a-448d-b07b-49071722a847_0

	74a4e3d88a70   a4ca41631cc7           "/coredns -conf /etc…"   2 minutes ago        Up 2 minutes (Paused)                   k8s_coredns_coredns-64897985d-rv9pb_kube-system_dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f_0

	8fa6dc58558e   b46c42588d51           "/usr/local/bin/kube…"   2 minutes ago        Up 2 minutes (Paused)                   k8s_kube-proxy_kube-proxy-zqfxj_kube-system_1825a520-13e0-4474-a4e0-67a41d7c78c6_0

	df30f3b8d297   k8s.gcr.io/pause:3.6   "/pause"                 2 minutes ago        Up 2 minutes (Paused)                   k8s_POD_kube-proxy-zqfxj_kube-system_1825a520-13e0-4474-a4e0-67a41d7c78c6_0

	d320cc67dbfe   k8s.gcr.io/pause:3.6   "/pause"                 2 minutes ago        Up 2 minutes (Paused)                   k8s_POD_coredns-64897985d-rv9pb_kube-system_dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f_0

	0312af21019e   b6d7abedde39           "kube-apiserver --ad…"   2 minutes ago        Up 2 minutes (Paused)                   k8s_kube-apiserver_kube-apiserver-pause-20211231111903-1576_kube-system_61a858f6d0a505095df4f4e361b4fe99_0

	59516730c193   71d575efe628           "kube-scheduler --au…"   2 minutes ago        Up 2 minutes (Paused)                   k8s_kube-scheduler_kube-scheduler-pause-20211231111903-1576_kube-system_1b44de50cea5ab5eb4c4156cdbe670e2_0

	0cc844e63a7c   f51846a4fd28           "kube-controller-man…"   2 minutes ago        Up 2 minutes (Paused)                   k8s_kube-controller-manager_kube-controller-manager-pause-20211231111903-1576_kube-system_10435ba0d5da11c3134135f4e5f33b73_0

	0843676a5aa7   25f8c7f3da61           "etcd --advertise-cl…"   2 minutes ago        Up 2 minutes                            k8s_etcd_etcd-pause-20211231111903-1576_kube-system_ab6596944a7a3af683b87c004de894f8_0

	101beefb89f1   k8s.gcr.io/pause:3.6   "/pause"                 2 minutes ago        Up 2 minutes (Paused)                   k8s_POD_kube-scheduler-pause-20211231111903-1576_kube-system_1b44de50cea5ab5eb4c4156cdbe670e2_0

	2b8f428d720b   k8s.gcr.io/pause:3.6   "/pause"                 2 minutes ago        Up 2 minutes (Paused)                   k8s_POD_kube-controller-manager-pause-20211231111903-1576_kube-system_10435ba0d5da11c3134135f4e5f33b73_0

	50cfe963fa30   k8s.gcr.io/pause:3.6   "/pause"                 2 minutes ago        Up 2 minutes (Paused)                   k8s_POD_kube-apiserver-pause-20211231111903-1576_kube-system_61a858f6d0a505095df4f4e361b4fe99_0

	62f3e2013ffe   k8s.gcr.io/pause:3.6   "/pause"                 2 minutes ago        Up 2 minutes (Paused)                   k8s_POD_etcd-pause-20211231111903-1576_kube-system_ab6596944a7a3af683b87c004de894f8_0

	* 

	* ==> coredns [74a4e3d88a70] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API

	.:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.6

	linux/amd64, go1.17.1, 13a9191

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] Reloading

	[INFO] plugin/health: Going into lameduck mode for 5s

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	[INFO] Reloading complete

	* 

	* ==> describe nodes <==

	* 

	* ==> dmesg <==

	* [Dec31 11:07] WSL2: Performing memory compaction.

	[Dec31 11:08] WSL2: Performing memory compaction.

	[Dec31 11:09] WSL2: Performing memory compaction.

	[Dec31 11:10] WSL2: Performing memory compaction.

	[Dec31 11:11] WSL2: Performing memory compaction.

	[Dec31 11:12] WSL2: Performing memory compaction.

	[Dec31 11:13] WSL2: Performing memory compaction.

	[Dec31 11:14] WSL2: Performing memory compaction.

	[Dec31 11:15] WSL2: Performing memory compaction.

	[ +22.250121] process 'docker/tmp/qemu-check699144709/check' started with executable stack

	[Dec31 11:16] WSL2: Performing memory compaction.

	[Dec31 11:18] WSL2: Performing memory compaction.

	[Dec31 11:20] WSL2: Performing memory compaction.

	[Dec31 11:21] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000006] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.003869] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000005] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.001553] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000003] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000661] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000005] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.054411] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000006] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[Dec31 11:24] WSL2: Performing memory compaction.

	[ +33.237444] hrtimer: interrupt took 426600 ns

	* 

	* ==> etcd [0843676a5aa7] <==

	* {"level":"warn","ts":"2021-12-31T11:23:58.263Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:57.723Z","time spent":"540.8338ms","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""}

	{"level":"warn","ts":"2021-12-31T11:23:58.264Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:57.723Z","time spent":"540.3328ms","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-12-31T11:23:58.264Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:57.723Z","time spent":"540.3343ms","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-12-31T11:23:58.264Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:57.724Z","time spent":"540.1756ms","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-12-31T11:23:58.275Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.5579609s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/coredns-64897985d-rv9pb\" ","response":"","error":"context canceled"}

	{"level":"info","ts":"2021-12-31T11:23:58.275Z","caller":"traceutil/trace.go:171","msg":"trace[1873031848] range","detail":"{range_begin:/registry/pods/kube-system/coredns-64897985d-rv9pb; range_end:; }","duration":"2.5585022s","start":"2021-12-31T11:23:55.717Z","end":"2021-12-31T11:23:58.275Z","steps":["trace[1873031848] 'agreement among raft nodes before linearized reading'  (duration: 2.1531394s)","trace[1873031848] 'range keys from in-memory index tree'  (duration: 405.108ms)"],"step_count":2}

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.5387194s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/pause-20211231111903-1576\" ","response":"","error":"context canceled"}

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.5442229s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-apiserver-pause-20211231111903-1576\" ","response":"","error":"context canceled"}

	{"level":"info","ts":"2021-12-31T11:23:58.276Z","caller":"traceutil/trace.go:171","msg":"trace[1885684326] range","detail":"{range_begin:/registry/pods/kube-system/kube-apiserver-pause-20211231111903-1576; range_end:; }","duration":"2.5443138s","start":"2021-12-31T11:23:55.731Z","end":"2021-12-31T11:23:58.276Z","steps":["trace[1885684326] 'agreement among raft nodes before linearized reading'  (duration: 2.1386993s)","trace[1885684326] 'range keys from in-memory index tree'  (duration: 405.5064ms)"],"step_count":2}

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:55.731Z","time spent":"2.5443715s","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Range","request count":0,"request size":69,"response count":0,"response size":0,"request content":"key:\"/registry/pods/kube-system/kube-apiserver-pause-20211231111903-1576\" "}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"405.318ms","expected-duration":"100ms","prefix":"","request":"header:<ID:8128010035642347343 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/pods/kube-system/etcd-pause-20211231111903-1576\" mod_revision:0 > success:<request_put:<key:\"/registry/pods/kube-system/etcd-pause-20211231111903-1576\" value_size:3946 >> failure:<>>","response":"size:5"}

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:55.717Z","time spent":"2.5585783s","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":0,"response size":0,"request content":"key:\"/registry/pods/kube-system/coredns-64897985d-rv9pb\" "}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"info","ts":"2021-12-31T11:23:58.276Z","caller":"traceutil/trace.go:171","msg":"trace[315008577] range","detail":"{range_begin:/registry/minions/pause-20211231111903-1576; range_end:; }","duration":"2.5388448s","start":"2021-12-31T11:23:55.737Z","end":"2021-12-31T11:23:58.276Z","steps":["trace[315008577] 'agreement among raft nodes before linearized reading'  (duration: 2.1333195s)","trace[315008577] 'range keys from in-memory index tree'  (duration: 405.3904ms)"],"step_count":2}

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:55.737Z","time spent":"2.5391542s","remote":"127.0.0.1:37928","response type":"/etcdserverpb.KV/Range","request count":0,"request size":45,"response count":0,"response size":0,"request content":"key:\"/registry/minions/pause-20211231111903-1576\" "}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.5581128s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/storage-provisioner\" ","response":"","error":"context canceled"}

	{"level":"info","ts":"2021-12-31T11:23:58.276Z","caller":"traceutil/trace.go:171","msg":"trace[2119726512] range","detail":"{range_begin:/registry/pods/kube-system/storage-provisioner; range_end:; }","duration":"2.5587074s","start":"2021-12-31T11:23:55.717Z","end":"2021-12-31T11:23:58.276Z","steps":["trace[2119726512] 'agreement among raft nodes before linearized reading'  (duration: 2.1526472s)","trace[2119726512] 'range keys from in-memory index tree'  (duration: 405.4532ms)"],"step_count":2}

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:55.717Z","time spent":"2.5587655s","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Range","request count":0,"request size":48,"response count":0,"response size":0,"request content":"key:\"/registry/pods/kube-system/storage-provisioner\" "}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-12-31T11:24:07.013Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.2903296s","expected-duration":"1s"}

	* 

	* ==> kernel <==

	*  11:24:40 up  1:43,  0 users,  load average: 7.47, 5.74, 3.55

	Linux pause-20211231111903-1576 5.10.16.3-microsoft-standard-WSL2 #1 SMP Fri Apr 2 22:23:49 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* 

	* ==> kube-apiserver [0312af21019e] <==

	* E1231 11:23:58.294148       1 timeout.go:137] post-timeout activity - time-elapsed: 31.4657ms, POST "/api/v1/namespaces/kube-system/serviceaccounts/storage-provisioner/token" result: <nil>

	E1231 11:23:58.295180       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E1231 11:23:58.296480       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E1231 11:23:58.297959       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	I1231 11:23:58.299328       1 trace.go:205] Trace[719232061]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:Go-http-client/2.0,audit-id:e7c9b0d6-026b-48f1-89a1-708570631734,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-Dec-2021 11:23:52.919) (total time: 5379ms):

	Trace[719232061]: [5.3795541s] [5.3795541s] END

	E1231 11:23:58.299630       1 timeout.go:137] post-timeout activity - time-elapsed: 37.5051ms, POST "/api/v1/namespaces/kube-system/pods" result: <nil>

	E1231 11:23:58.300710       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	I1231 11:23:58.303363       1 trace.go:205] Trace[43791266]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:Go-http-client/2.0,audit-id:519e899d-3e8c-4da2-bdb2-429135cc6087,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-Dec-2021 11:23:52.919) (total time: 5383ms):

	Trace[43791266]: [5.383774s] [5.383774s] END

	E1231 11:23:58.303777       1 timeout.go:137] post-timeout activity - time-elapsed: 41.1881ms, POST "/api/v1/namespaces/kube-system/pods" result: <nil>

	I1231 11:23:58.306018       1 trace.go:205] Trace[1404886063]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:Go-http-client/2.0,audit-id:a1e5f97d-dd66-4df0-a31b-5bfd15dfabfa,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-Dec-2021 11:23:52.918) (total time: 5387ms):

	Trace[1404886063]: [5.3870804s] [5.3870804s] END

	E1231 11:23:58.306349       1 timeout.go:137] post-timeout activity - time-elapsed: 43.5371ms, POST "/api/v1/namespaces/kube-system/pods" result: <nil>

	E1231 11:23:58.307412       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	I1231 11:23:58.309007       1 trace.go:205] Trace[90276809]: "Create" url:/api/v1/namespaces/kube-system/serviceaccounts/coredns/token,user-agent:Go-http-client/2.0,audit-id:4ef675c9-4d20-48b9-af0a-1cce4571c748,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-Dec-2021 11:23:53.545) (total time: 4763ms):

	Trace[90276809]: [4.763649s] [4.763649s] END

	E1231 11:23:58.309299       1 timeout.go:137] post-timeout activity - time-elapsed: 46.6689ms, POST "/api/v1/namespaces/kube-system/serviceaccounts/coredns/token" result: <nil>

	E1231 11:23:58.311634       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	I1231 11:23:58.316141       1 trace.go:205] Trace[1743682991]: "Get" url:/api/v1/nodes/pause-20211231111903-1576,user-agent:Go-http-client/2.0,audit-id:a9caef0d-1c8d-4c4a-8893-7d912f70ee8d,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-Dec-2021 11:23:55.736) (total time: 2579ms):

	Trace[1743682991]: [2.579723s] [2.579723s] END

	I1231 11:23:58.318992       1 trace.go:205] Trace[1139424570]: "Get" url:/api/v1/namespaces/kube-system/pods/kube-apiserver-pause-20211231111903-1576,user-agent:Go-http-client/2.0,audit-id:cf6a805b-015d-4b9e-b0a1-e3e04a0924a8,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-Dec-2021 11:23:55.730) (total time: 2588ms):

	Trace[1139424570]: [2.5880837s] [2.5880837s] END

	E1231 11:23:58.319251       1 timeout.go:137] post-timeout activity - time-elapsed: 56.2576ms, GET "/api/v1/namespaces/kube-system/pods/kube-apiserver-pause-20211231111903-1576" result: <nil>

	E1231 11:23:58.324741       1 timeout.go:137] post-timeout activity - time-elapsed: 61.7735ms, GET "/api/v1/nodes/pause-20211231111903-1576" result: <nil>

	* 

	* ==> kube-controller-manager [0cc844e63a7c] <==

	* W1231 11:22:00.315755       1 node_lifecycle_controller.go:1012] Missing timestamp for Node pause-20211231111903-1576. Assuming now as a timestamp.

	I1231 11:22:00.315850       1 node_lifecycle_controller.go:1163] Controller detected that all Nodes are not-Ready. Entering master disruption mode.

	I1231 11:22:00.319936       1 shared_informer.go:247] Caches are synced for expand 

	I1231 11:22:00.322866       1 shared_informer.go:247] Caches are synced for HPA 

	I1231 11:22:00.323621       1 shared_informer.go:247] Caches are synced for ReplicationController 

	I1231 11:22:00.323975       1 shared_informer.go:247] Caches are synced for job 

	I1231 11:22:00.331200       1 range_allocator.go:374] Set node pause-20211231111903-1576 PodCIDR to [10.244.0.0/24]

	I1231 11:22:00.412677       1 shared_informer.go:240] Waiting for caches to sync for garbage collector

	I1231 11:22:00.512103       1 shared_informer.go:247] Caches are synced for stateful set 

	I1231 11:22:00.512119       1 shared_informer.go:247] Caches are synced for daemon sets 

	I1231 11:22:00.512510       1 shared_informer.go:247] Caches are synced for resource quota 

	I1231 11:22:00.512613       1 shared_informer.go:247] Caches are synced for resource quota 

	I1231 11:22:00.512627       1 shared_informer.go:247] Caches are synced for disruption 

	I1231 11:22:00.512638       1 disruption.go:371] Sending events to api server.

	I1231 11:22:00.512737       1 shared_informer.go:247] Caches are synced for deployment 

	I1231 11:22:00.728021       1 event.go:294] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-64897985d to 2"

	I1231 11:22:01.011579       1 shared_informer.go:247] Caches are synced for garbage collector 

	I1231 11:22:01.011707       1 garbagecollector.go:155] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I1231 11:22:01.013055       1 shared_informer.go:247] Caches are synced for garbage collector 

	I1231 11:22:01.026651       1 event.go:294] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-zqfxj"

	I1231 11:22:01.212406       1 event.go:294] "Event occurred" object="kube-system/coredns-64897985d" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-64897985d-s84z4"

	I1231 11:22:01.312858       1 event.go:294] "Event occurred" object="kube-system/coredns-64897985d" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-64897985d-rv9pb"

	I1231 11:22:01.433025       1 event.go:294] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-64897985d to 1"

	I1231 11:22:01.614430       1 event.go:294] "Event occurred" object="kube-system/coredns-64897985d" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-64897985d-s84z4"

	I1231 11:22:05.317090       1 node_lifecycle_controller.go:1190] Controller detected that some Nodes are Ready. Exiting master disruption mode.

	* 

	* ==> kube-proxy [8fa6dc58558e] <==

	* E1231 11:22:06.322692       1 proxier.go:647] "Failed to read builtin modules file, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" err="open /lib/modules/5.10.16.3-microsoft-standard-WSL2/modules.builtin: no such file or directory" filePath="/lib/modules/5.10.16.3-microsoft-standard-WSL2/modules.builtin"

	I1231 11:22:06.330341       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs"

	I1231 11:22:06.334575       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs_rr"

	I1231 11:22:06.338855       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs_wrr"

	I1231 11:22:06.342924       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs_sh"

	I1231 11:22:06.347232       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="nf_conntrack"

	I1231 11:22:06.433986       1 node.go:163] Successfully retrieved node IP: 192.168.49.2

	I1231 11:22:06.434204       1 server_others.go:138] "Detected node IP" address="192.168.49.2"

	I1231 11:22:06.434835       1 server_others.go:561] "Unknown proxy mode, assuming iptables proxy" proxyMode=""

	I1231 11:22:06.716109       1 server_others.go:206] "Using iptables Proxier"

	I1231 11:22:06.716372       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4

	I1231 11:22:06.716414       1 server_others.go:214] "Creating dualStackProxier for iptables"

	I1231 11:22:06.716624       1 server_others.go:491] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"

	I1231 11:22:06.718361       1 server.go:656] "Version info" version="v1.23.1"

	I1231 11:22:06.722154       1 config.go:317] "Starting service config controller"

	I1231 11:22:06.723022       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1231 11:22:06.722649       1 config.go:226] "Starting endpoint slice config controller"

	I1231 11:22:06.723514       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1231 11:22:06.824415       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I1231 11:22:06.824436       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-scheduler [59516730c193] <==

	* W1231 11:21:43.788202       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1231 11:21:43.788349       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W1231 11:21:43.832888       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1231 11:21:43.833005       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W1231 11:21:43.837588       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1231 11:21:43.837692       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W1231 11:21:43.868940       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1231 11:21:43.869067       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	W1231 11:21:44.088882       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1231 11:21:44.089013       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W1231 11:21:44.148556       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E1231 11:21:44.148722       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W1231 11:21:44.166924       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1231 11:21:44.167196       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W1231 11:21:44.206891       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1231 11:21:44.207006       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W1231 11:21:44.217132       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1231 11:21:44.217352       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W1231 11:21:44.253843       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1231 11:21:44.253997       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W1231 11:21:44.338017       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1231 11:21:44.338162       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W1231 11:21:45.526567       1 reflector.go:324] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1231 11:21:45.526774       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	I1231 11:21:51.740417       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-12-31 11:20:35 UTC, end at Fri 2021-12-31 11:24:41 UTC. --

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942451    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/61a858f6d0a505095df4f4e361b4fe99-etc-ca-certificates\") pod \"kube-apiserver-pause-20211231111903-1576\" (UID: \"61a858f6d0a505095df4f4e361b4fe99\") " pod="kube-system/kube-apiserver-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942525    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/61a858f6d0a505095df4f4e361b4fe99-usr-share-ca-certificates\") pod \"kube-apiserver-pause-20211231111903-1576\" (UID: \"61a858f6d0a505095df4f4e361b4fe99\") " pod="kube-system/kube-apiserver-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942571    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/1825a520-13e0-4474-a4e0-67a41d7c78c6-kube-proxy\") pod \"kube-proxy-zqfxj\" (UID: \"1825a520-13e0-4474-a4e0-67a41d7c78c6\") " pod="kube-system/kube-proxy-zqfxj"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942635    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f-config-volume\") pod \"coredns-64897985d-rv9pb\" (UID: \"dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f\") " pod="kube-system/coredns-64897985d-rv9pb"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942675    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/b045595f-407a-448d-b07b-49071722a847-tmp\") pod \"storage-provisioner\" (UID: \"b045595f-407a-448d-b07b-49071722a847\") " pod="kube-system/storage-provisioner"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942719    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/61a858f6d0a505095df4f4e361b4fe99-ca-certs\") pod \"kube-apiserver-pause-20211231111903-1576\" (UID: \"61a858f6d0a505095df4f4e361b4fe99\") " pod="kube-system/kube-apiserver-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942879    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/61a858f6d0a505095df4f4e361b4fe99-usr-local-share-ca-certificates\") pod \"kube-apiserver-pause-20211231111903-1576\" (UID: \"61a858f6d0a505095df4f4e361b4fe99\") " pod="kube-system/kube-apiserver-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942959    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/1b44de50cea5ab5eb4c4156cdbe670e2-kubeconfig\") pod \"kube-scheduler-pause-20211231111903-1576\" (UID: \"1b44de50cea5ab5eb4c4156cdbe670e2\") " pod="kube-system/kube-scheduler-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943023    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/10435ba0d5da11c3134135f4e5f33b73-flexvolume-dir\") pod \"kube-controller-manager-pause-20211231111903-1576\" (UID: \"10435ba0d5da11c3134135f4e5f33b73\") " pod="kube-system/kube-controller-manager-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943109    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/10435ba0d5da11c3134135f4e5f33b73-k8s-certs\") pod \"kube-controller-manager-pause-20211231111903-1576\" (UID: \"10435ba0d5da11c3134135f4e5f33b73\") " pod="kube-system/kube-controller-manager-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943188    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/10435ba0d5da11c3134135f4e5f33b73-kubeconfig\") pod \"kube-controller-manager-pause-20211231111903-1576\" (UID: \"10435ba0d5da11c3134135f4e5f33b73\") " pod="kube-system/kube-controller-manager-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943235    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1825a520-13e0-4474-a4e0-67a41d7c78c6-lib-modules\") pod \"kube-proxy-zqfxj\" (UID: \"1825a520-13e0-4474-a4e0-67a41d7c78c6\") " pod="kube-system/kube-proxy-zqfxj"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943280    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-certs\" (UniqueName: \"kubernetes.io/host-path/ab6596944a7a3af683b87c004de894f8-etcd-certs\") pod \"etcd-pause-20211231111903-1576\" (UID: \"ab6596944a7a3af683b87c004de894f8\") " pod="kube-system/etcd-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943327    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/10435ba0d5da11c3134135f4e5f33b73-ca-certs\") pod \"kube-controller-manager-pause-20211231111903-1576\" (UID: \"10435ba0d5da11c3134135f4e5f33b73\") " pod="kube-system/kube-controller-manager-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943395    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/10435ba0d5da11c3134135f4e5f33b73-etc-ca-certificates\") pod \"kube-controller-manager-pause-20211231111903-1576\" (UID: \"10435ba0d5da11c3134135f4e5f33b73\") " pod="kube-system/kube-controller-manager-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943444    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz989\" (UniqueName: \"kubernetes.io/projected/1825a520-13e0-4474-a4e0-67a41d7c78c6-kube-api-access-nz989\") pod \"kube-proxy-zqfxj\" (UID: \"1825a520-13e0-4474-a4e0-67a41d7c78c6\") " pod="kube-system/kube-proxy-zqfxj"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943489    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54z9w\" (UniqueName: \"kubernetes.io/projected/b045595f-407a-448d-b07b-49071722a847-kube-api-access-54z9w\") pod \"storage-provisioner\" (UID: \"b045595f-407a-448d-b07b-49071722a847\") " pod="kube-system/storage-provisioner"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943573    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/61a858f6d0a505095df4f4e361b4fe99-k8s-certs\") pod \"kube-apiserver-pause-20211231111903-1576\" (UID: \"61a858f6d0a505095df4f4e361b4fe99\") " pod="kube-system/kube-apiserver-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943686    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/10435ba0d5da11c3134135f4e5f33b73-usr-share-ca-certificates\") pod \"kube-controller-manager-pause-20211231111903-1576\" (UID: \"10435ba0d5da11c3134135f4e5f33b73\") " pod="kube-system/kube-controller-manager-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943947    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/1825a520-13e0-4474-a4e0-67a41d7c78c6-xtables-lock\") pod \"kube-proxy-zqfxj\" (UID: \"1825a520-13e0-4474-a4e0-67a41d7c78c6\") " pod="kube-system/kube-proxy-zqfxj"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.944006    4115 reconciler.go:157] "Reconciler: start to sync state"

	Dec 31 11:23:58 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:58.137379    4115 dynamic_cafile_content.go:170] "Shutting down controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	Dec 31 11:23:58 pause-20211231111903-1576 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...

	Dec 31 11:23:58 pause-20211231111903-1576 systemd[1]: kubelet.service: Succeeded.

	Dec 31 11:23:58 pause-20211231111903-1576 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* 

	* ==> storage-provisioner [f058545bad9d] <==

	* 	/usr/local/go/src/sync/cond.go:56 +0x99

	k8s.io/client-go/util/workqueue.(*Type).Get(0xc0000b8420, 0x0, 0x0, 0x0)

		/Users/medya/go/pkg/mod/k8s.io/client-go@v0.20.5/util/workqueue/queue.go:145 +0x89

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextVolumeWorkItem(0xc0003eec80, 0x18e5530, 0xc00045ca00, 0x203000)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:990 +0x3e

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runVolumeWorker(...)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:929

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.3()

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x5c

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00057e2c0)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:155 +0x5f

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00057e2c0, 0x18b3d60, 0xc000320cf0, 0x1, 0xc000108540)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:156 +0x9b

	k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00057e2c0, 0x3b9aca00, 0x0, 0x1, 0xc000108540)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:133 +0x98

	k8s.io/apimachinery/pkg/util/wait.Until(0xc00057e2c0, 0x3b9aca00, 0xc000108540)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:90 +0x4d

	created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x3d6

	goroutine 108 [runnable]:

	k8s.io/client-go/tools/record.(*recorderImpl).generateEvent.func1(0xc00053c2c0, 0xc000160a00)

		/Users/medya/go/pkg/mod/k8s.io/client-go@v0.20.5/tools/record/event.go:341

	created by k8s.io/client-go/tools/record.(*recorderImpl).generateEvent

		/Users/medya/go/pkg/mod/k8s.io/client-go@v0.20.5/tools/record/event.go:341 +0x3b7

-- /stdout --

** stderr ** 

	E1231 11:24:39.942141    2952 logs.go:192] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	Unable to connect to the server: net/http: TLS handshake timeout

	 output: "\n** stderr ** \nUnable to connect to the server: net/http: TLS handshake timeout\n\n** /stderr **"

	! unable to fetch logs for: describe nodes

** /stderr **

helpers_test.go:255: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.APIServer}} -p pause-20211231111903-1576 -n pause-20211231111903-1576

helpers_test.go:255: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p pause-20211231111903-1576 -n pause-20211231111903-1576: exit status 2 (9.0526538s)

-- stdout --

	Paused

-- /stdout --

helpers_test.go:255: status error: exit status 2 (may be ok)

helpers_test.go:257: "pause-20211231111903-1576" apiserver is not running, skipping kubectl commands (state="Paused")

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestPause/serial/PauseAgain]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect pause-20211231111903-1576

helpers_test.go:232: (dbg) Done: docker inspect pause-20211231111903-1576: (1.4553347s)

helpers_test.go:236: (dbg) docker inspect pause-20211231111903-1576:

-- stdout --

	[

	    {

	        "Id": "1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939",

	        "Created": "2021-12-31T11:20:29.4220091Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 140179,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-12-31T11:20:34.3453303Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:64d09634c60d2a75596bc705aa84bdc41f76fe47c5d9ee362550bffbdc256979",

	        "ResolvConfPath": "/var/lib/docker/containers/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939/hostname",

	        "HostsPath": "/var/lib/docker/containers/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939/hosts",

	        "LogPath": "/var/lib/docker/containers/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939-json.log",

	        "Name": "/pause-20211231111903-1576",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "pause-20211231111903-1576:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "pause-20211231111903-1576",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2147483648,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                {

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

	                }

	            ],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 2147483648,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/6d359abb314d7bfb2a472b74bfae13c89d61fc9fda0da2fdcee73f107d73eda9-init/diff:/var/lib/docker/overlay2/236e34868c6bd5ecc10a009188d3dd414c10322ed61f0f8bd2f0cc6afe31d4a2/diff:/var/lib/docker/overlay2/4f26d83e8780f057af23a45796afe2feeb4c6225d04f3e75d86d76ce33e6eeb7/diff:/var/lib/docker/overlay2/1aa2f7df6f61654ba127b3d7ca8e4c7c9faa9ea133a905aee86c5c729b50580e/diff:/var/lib/docker/overlay2/810f58a572d447e357f0e37fcb6e434743ec2c41f1a828b80ea35481ad056b01/diff:/var/lib/docker/overlay2/0f8aaf037fa7c7675cf275f7d2ec3ea76e658acf5a3dab8397689e8f0f123d26/diff:/var/lib/docker/overlay2/be7ae9f76a1638260aab5f1fa7ff3040af697c9a44380f0cc9d6b9f8e13fc3d0/diff:/var/lib/docker/overlay2/ef02c9f68049a2b4bbb3c853a879f858f696367e0e4a0cd3c8f8a560cf64f559/diff:/var/lib/docker/overlay2/35131ade500d28bbea06e314019475aaefc896faf010312fe4a992789b633265/diff:/var/lib/docker/overlay2/8d9649b172e37864a9f036c4de74b67ea5b01978cffc6a9362049d5ea5d6f55d/diff:/var/lib/docker/overlay2/52868f

77169cdf9bc78bcde8ac7ec95f1a8185a6302edb584dbf9a6360daf03a/diff:/var/lib/docker/overlay2/f8c18464f7aef662c8d4ad84d2451d43835e5f4569a4d2b9f30ad97322903d11/diff:/var/lib/docker/overlay2/0101fb0a80bf47a589e85bb95fd060770df32c7a11dbd8a7dcfef4d9d01f8af2/diff:/var/lib/docker/overlay2/07d0477dc6604496cacf7ed9c358a06fe7d29546c33411fecdaf0ecaa2a9a0ef/diff:/var/lib/docker/overlay2/3f31c6e0e5aac9e858d82dd03ebea66448458f5a927add3f654a304d2c37e502/diff:/var/lib/docker/overlay2/d7ed3b53a0a390071295a19edc1e7d6c00a99dfe061348b28a62f8b9a82318d0/diff:/var/lib/docker/overlay2/3b636a10aa41811f93fe647f4a2254548b80bdeb098c8533b22c4d79d53fcdf0/diff:/var/lib/docker/overlay2/ce837cfcf557adff25b0b4b5f4d6f01e0cf5a1b8bb23ee431d224975cacbe2b0/diff:/var/lib/docker/overlay2/3605fc7a2584009be0a2860c72bef0b598b9bc1f266a398074b7c8a7123333b1/diff:/var/lib/docker/overlay2/05a27701432d46329015577bf385d007c4190625712f8101bb39d9a5744fae1b/diff:/var/lib/docker/overlay2/c25e37734ac3910f77446ef67a386f29de76d35b911b15e745ab7622def0e089/diff:/var/lib/d

ocker/overlay2/a8e782b00e5454fb7d4ededfc9896090aac72e1b0b4c00e43cc9e0bdcf4d2906/diff:/var/lib/docker/overlay2/44c82f3c0e578428d3d9bd874ec44bdd533b0d6845072a4aac19be4720565273/diff:/var/lib/docker/overlay2/14d59fa1343c7e69048f262f4f3f304832c41b33f9f6b5d17a01d67b6c488996/diff:/var/lib/docker/overlay2/15c980de9f5f13135282866b74e142b0c02c48a68d5b570fdb352734d154c43c/diff:/var/lib/docker/overlay2/82368a0688767ffd3b7eb2fd7f8cf27704e4ae4f7ecbb8b8b73f437e928c0db7/diff:/var/lib/docker/overlay2/e976758fe64d0a07d050f840cfff6da24646e500eb0758ad525eec4402c332fb/diff:/var/lib/docker/overlay2/74148e6df6795f39b3025653e1114d8d16999f340f4ace621d5d37e82a3698fe/diff:/var/lib/docker/overlay2/05e29b3eb2babc45b9101583a4b8dc9c219237c4297f0678b648a934cd2cf604/diff:/var/lib/docker/overlay2/d7cae5db557577bece8070136b11e87052bce1263acb0b687e90567746b09f61/diff:/var/lib/docker/overlay2/5b1ff4405c06a77b96c7b61fbf1df81004551144d651ae61b632dfc3b269bc76/diff:/var/lib/docker/overlay2/f50ff6635032640d426a42ecb016d73fdb96ba15505a1ae4f01d7cb3315

925fb/diff:/var/lib/docker/overlay2/72f65c380012ae92d0675a1b93218ad4ecd8addccb3371324d814fa248daed27/diff:/var/lib/docker/overlay2/b1c4ea370005cb0ea474c83801a0ba4b376d83bfe171b465e61eeab9fbd46b68/diff:/var/lib/docker/overlay2/182b2273f71a8695b8a041e54bb701488b71028091c701a3271bdf6fd0f2c5f5/diff:/var/lib/docker/overlay2/31812fd31cbde39dd1044b048c3f74540d47fbb1dd15634a350ede4f6725dea5/diff:/var/lib/docker/overlay2/58541d8dc75e6a2ece804245b92e88e76345bdbbdda996fbd757eb2290e3e609/diff:/var/lib/docker/overlay2/207a2c171a9595e78850f4fe19c5e78e337c2201f45a4cebc01f869ca7eecf54/diff:/var/lib/docker/overlay2/93569597c37885046de0762af7ba9d6379d54b5533be30cc27f514859f28f7ba/diff:/var/lib/docker/overlay2/57f04579d4692224f2cabd08068218468a37e48174920084405ce9ae88d5d7a7/diff:/var/lib/docker/overlay2/db96b3bbab3bd95dcee0936a5ab318b82dcc941cc09c1fd201e21d97dd5d7617/diff:/var/lib/docker/overlay2/0560b92e88427b3710f730d81a8d910fa8c7feee2a4273c4abb5c51364213d07/diff:/var/lib/docker/overlay2/4e3f380bd40064fcfb56a83f831a38ef53e4ea

bbf36f7661d063e55ccf2972c0/diff:/var/lib/docker/overlay2/65534d10a48ed16cb8b24cc817d40ad1c80c0bbb261a2b966fb4e1bac0f2b524/diff:/var/lib/docker/overlay2/799e74a4ab0cf4fb970c0d6f14af7e37410bf1168fcb40d81c85c773f406f235/diff",

	                "MergedDir": "/var/lib/docker/overlay2/6d359abb314d7bfb2a472b74bfae13c89d61fc9fda0da2fdcee73f107d73eda9/merged",

	                "UpperDir": "/var/lib/docker/overlay2/6d359abb314d7bfb2a472b74bfae13c89d61fc9fda0da2fdcee73f107d73eda9/diff",

	                "WorkDir": "/var/lib/docker/overlay2/6d359abb314d7bfb2a472b74bfae13c89d61fc9fda0da2fdcee73f107d73eda9/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "pause-20211231111903-1576",

	                "Source": "/var/lib/docker/volumes/pause-20211231111903-1576/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "pause-20211231111903-1576",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "pause-20211231111903-1576",

	                "name.minikube.sigs.k8s.io": "pause-20211231111903-1576",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "3897f3612e443b75fcab56eb4d499da900ae876f2dfcc1560d0d94085c235110",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "56091"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "56092"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "56093"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "56089"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "56090"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/3897f3612e44",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "pause-20211231111903-1576": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "1c4b9f54092f",

	                        "pause-20211231111903-1576"

	                    ],

	                    "NetworkID": "e8cd998559035760d9e369351cf8a06ee0c2805f4b7230bdcb37f7d029f37d1c",

	                    "EndpointID": "36a5f19fb2d6d046dedc47c1d1cdf9c14f7dbef3a0bf07c43a593e42c799a861",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p pause-20211231111903-1576 -n pause-20211231111903-1576

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.Host}} -p pause-20211231111903-1576 -n pause-20211231111903-1576: exit status 2 (7.8908317s)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/PauseAgain FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/PauseAgain]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-windows-amd64.exe -p pause-20211231111903-1576 logs -n 25

=== CONT  TestPause/serial/PauseAgain

helpers_test.go:248: (dbg) Done: out/minikube-windows-amd64.exe -p pause-20211231111903-1576 logs -n 25: (20.871755s)

helpers_test.go:253: TestPause/serial/PauseAgain logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |------------|------------------------------------------|------------------------------------------|-------------------|---------|-------------------------------|-------------------------------|

	|  Command   |                   Args                   |                 Profile                  |       User        | Version |          Start Time           |           End Time            |

	|------------|------------------------------------------|------------------------------------------|-------------------|---------|-------------------------------|-------------------------------|

	| start      | -p                                       | scheduled-stop-20211231110332-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:03:33 GMT | Fri, 31 Dec 2021 11:05:50 GMT |

	|            | scheduled-stop-20211231110332-1576       |                                          |                   |         |                               |                               |

	|            | --memory=2048 --driver=docker            |                                          |                   |         |                               |                               |

	| stop       | -p                                       | scheduled-stop-20211231110332-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:05:51 GMT | Fri, 31 Dec 2021 11:05:56 GMT |

	|            | scheduled-stop-20211231110332-1576       |                                          |                   |         |                               |                               |

	|            | --schedule 5m                            |                                          |                   |         |                               |                               |

	| ssh        | -p                                       | scheduled-stop-20211231110332-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:06:04 GMT | Fri, 31 Dec 2021 11:06:10 GMT |

	|            | scheduled-stop-20211231110332-1576       |                                          |                   |         |                               |                               |

	|            | -- sudo systemctl show                   |                                          |                   |         |                               |                               |

	|            | minikube-scheduled-stop --no-page        |                                          |                   |         |                               |                               |

	| stop       | -p                                       | scheduled-stop-20211231110332-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:06:10 GMT | Fri, 31 Dec 2021 11:06:15 GMT |

	|            | scheduled-stop-20211231110332-1576       |                                          |                   |         |                               |                               |

	|            | --schedule 5s                            |                                          |                   |         |                               |                               |

	| delete     | -p                                       | scheduled-stop-20211231110332-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:07:21 GMT | Fri, 31 Dec 2021 11:07:43 GMT |

	|            | scheduled-stop-20211231110332-1576       |                                          |                   |         |                               |                               |

	| start      | -p                                       | skaffold-20211231110743-1576             | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:07:44 GMT | Fri, 31 Dec 2021 11:10:02 GMT |

	|            | skaffold-20211231110743-1576             |                                          |                   |         |                               |                               |

	|            | --memory=2600 --driver=docker            |                                          |                   |         |                               |                               |

	| docker-env | --shell none -p                          | skaffold-20211231110743-1576             | skaffold          | v1.24.0 | Fri, 31 Dec 2021 11:10:04 GMT | Fri, 31 Dec 2021 11:10:14 GMT |

	|            | skaffold-20211231110743-1576             |                                          |                   |         |                               |                               |

	|            | --user=skaffold                          |                                          |                   |         |                               |                               |

	| delete     | -p                                       | skaffold-20211231110743-1576             | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:11:15 GMT | Fri, 31 Dec 2021 11:11:40 GMT |

	|            | skaffold-20211231110743-1576             |                                          |                   |         |                               |                               |

	| delete     | -p                                       | insufficient-storage-20211231111140-1576 | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:13:31 GMT | Fri, 31 Dec 2021 11:13:52 GMT |

	|            | insufficient-storage-20211231111140-1576 |                                          |                   |         |                               |                               |

	| start      | -p                                       | NoKubernetes-20211231111352-1576         | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:13:53 GMT | Fri, 31 Dec 2021 11:17:25 GMT |

	|            | NoKubernetes-20211231111352-1576         |                                          |                   |         |                               |                               |

	|            | --driver=docker                          |                                          |                   |         |                               |                               |

	| start      | -p                                       | offline-docker-20211231111352-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:13:53 GMT | Fri, 31 Dec 2021 11:18:22 GMT |

	|            | offline-docker-20211231111352-1576       |                                          |                   |         |                               |                               |

	|            | --alsologtostderr -v=1                   |                                          |                   |         |                               |                               |

	|            | --memory=2048 --wait=true                |                                          |                   |         |                               |                               |

	|            | --driver=docker                          |                                          |                   |         |                               |                               |

	| start      | -p                                       | NoKubernetes-20211231111352-1576         | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:17:34 GMT | Fri, 31 Dec 2021 11:18:23 GMT |

	|            | NoKubernetes-20211231111352-1576         |                                          |                   |         |                               |                               |

	|            | --no-kubernetes --driver=docker          |                                          |                   |         |                               |                               |

	| delete     | -p                                       | offline-docker-20211231111352-1576       | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:18:22 GMT | Fri, 31 Dec 2021 11:19:03 GMT |

	|            | offline-docker-20211231111352-1576       |                                          |                   |         |                               |                               |

	| delete     | -p                                       | NoKubernetes-20211231111352-1576         | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:18:58 GMT | Fri, 31 Dec 2021 11:19:18 GMT |

	|            | NoKubernetes-20211231111352-1576         |                                          |                   |         |                               |                               |

	| start      | -p                                       | kubernetes-upgrade-20211231111918-1576   | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:19:19 GMT | Fri, 31 Dec 2021 11:22:08 GMT |

	|            | kubernetes-upgrade-20211231111918-1576   |                                          |                   |         |                               |                               |

	|            | --memory=2200                            |                                          |                   |         |                               |                               |

	|            | --kubernetes-version=v1.16.0             |                                          |                   |         |                               |                               |

	|            | --alsologtostderr -v=1 --driver=docker   |                                          |                   |         |                               |                               |

	| stop       | -p                                       | kubernetes-upgrade-20211231111918-1576   | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:22:08 GMT | Fri, 31 Dec 2021 11:22:21 GMT |

	|            | kubernetes-upgrade-20211231111918-1576   |                                          |                   |         |                               |                               |

	| start      | -p pause-20211231111903-1576             | pause-20211231111903-1576                | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:19:03 GMT | Fri, 31 Dec 2021 11:22:33 GMT |

	|            | --memory=2048                            |                                          |                   |         |                               |                               |

	|            | --install-addons=false                   |                                          |                   |         |                               |                               |

	|            | --wait=all --driver=docker               |                                          |                   |         |                               |                               |

	| start      | -p                                       | running-upgrade-20211231111352-1576      | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:21:01 GMT | Fri, 31 Dec 2021 11:22:49 GMT |

	|            | running-upgrade-20211231111352-1576      |                                          |                   |         |                               |                               |

	|            | --memory=2200 --alsologtostderr          |                                          |                   |         |                               |                               |

	|            | -v=1 --driver=docker                     |                                          |                   |         |                               |                               |

	| start      | -p pause-20211231111903-1576             | pause-20211231111903-1576                | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:22:33 GMT | Fri, 31 Dec 2021 11:23:24 GMT |

	|            | --alsologtostderr -v=1                   |                                          |                   |         |                               |                               |

	|            | --driver=docker                          |                                          |                   |         |                               |                               |

	| delete     | -p                                       | running-upgrade-20211231111352-1576      | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:22:49 GMT | Fri, 31 Dec 2021 11:23:27 GMT |

	|            | running-upgrade-20211231111352-1576      |                                          |                   |         |                               |                               |

	| pause      | -p pause-20211231111903-1576             | pause-20211231111903-1576                | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:23:25 GMT | Fri, 31 Dec 2021 11:23:33 GMT |

	|            | --alsologtostderr -v=5                   |                                          |                   |         |                               |                               |

	| unpause    | -p pause-20211231111903-1576             | pause-20211231111903-1576                | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:23:42 GMT | Fri, 31 Dec 2021 11:23:51 GMT |

	|            | --alsologtostderr -v=5                   |                                          |                   |         |                               |                               |

	| start      | -p                                       | stopped-upgrade-20211231111352-1576      | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:22:10 GMT | Fri, 31 Dec 2021 11:24:21 GMT |

	|            | stopped-upgrade-20211231111352-1576      |                                          |                   |         |                               |                               |

	|            | --memory=2200 --alsologtostderr          |                                          |                   |         |                               |                               |

	|            | -v=1 --driver=docker                     |                                          |                   |         |                               |                               |

	| logs       | -p                                       | stopped-upgrade-20211231111352-1576      | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:24:21 GMT | Fri, 31 Dec 2021 11:24:35 GMT |

	|            | stopped-upgrade-20211231111352-1576      |                                          |                   |         |                               |                               |

	| -p         | pause-20211231111903-1576 logs           | pause-20211231111903-1576                | minikube7\jenkins | v1.24.0 | Fri, 31 Dec 2021 11:24:17 GMT | Fri, 31 Dec 2021 11:24:41 GMT |

	|            | -n 25                                    |                                          |                   |         |                               |                               |

	|------------|------------------------------------------|------------------------------------------|-------------------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/12/31 11:22:33

	Running on machine: minikube7

	Binary: Built with gc go1.17.5 for windows/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1231 11:22:33.283143    6964 out.go:297] Setting OutFile to fd 1476 ...

	I1231 11:22:33.346141    6964 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 11:22:33.346141    6964 out.go:310] Setting ErrFile to fd 1588...

	I1231 11:22:33.346141    6964 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 11:22:33.359162    6964 out.go:304] Setting JSON to false

	I1231 11:22:33.361133    6964 start.go:112] hostinfo: {"hostname":"minikube7","uptime":36194,"bootTime":1640913559,"procs":156,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.18363 Build 18363","kernelVersion":"10.0.18363 Build 18363","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f66ed2ea-6c04-4a6b-8eea-b2fb0953e990"}

	W1231 11:22:33.361133    6964 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1231 11:22:33.367136    6964 out.go:176] * [pause-20211231111903-1576] minikube v1.24.0 on Microsoft Windows 10 Enterprise N 10.0.18363 Build 18363

	I1231 11:22:33.367136    6964 notify.go:174] Checking for updates...

	I1231 11:22:33.371136    6964 out.go:176]   - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 11:22:33.374147    6964 out.go:176]   - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	I1231 11:22:33.376145    6964 out.go:176]   - MINIKUBE_LOCATION=12739

	I1231 11:22:33.023773    4432 out.go:176] * Pulling base image ...

	I1231 11:22:33.023773    4432 preload.go:132] Checking if preload exists for k8s version v1.23.2-rc.0 and runtime docker

	I1231 11:22:33.023773    4432 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b in local docker daemon

	I1231 11:22:33.023773    4432 preload.go:148] Found local preload: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.2-rc.0-docker-overlay2-amd64.tar.lz4

	I1231 11:22:33.024787    4432 cache.go:57] Caching tarball of preloaded images

	I1231 11:22:33.024787    4432 preload.go:174] Found C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.2-rc.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1231 11:22:33.024787    4432 cache.go:60] Finished verifying existence of preloaded tar for  v1.23.2-rc.0 on docker

	I1231 11:22:33.024787    4432 profile.go:147] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\config.json ...

	I1231 11:22:34.423114    4432 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b in local docker daemon, skipping pull

	I1231 11:22:34.423114    4432 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b exists in daemon, skipping load

	I1231 11:22:34.423114    4432 cache.go:206] Successfully downloaded all kic artifacts

	I1231 11:22:34.423114    4432 start.go:313] acquiring machines lock for kubernetes-upgrade-20211231111918-1576: {Name:mk180caff95a643cf3c5b99efd39bcaa55f7621c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1231 11:22:34.423114    4432 start.go:317] acquired machines lock for "kubernetes-upgrade-20211231111918-1576" in 0s

	I1231 11:22:34.423114    4432 start.go:93] Skipping create...Using existing machine configuration

	I1231 11:22:34.423114    4432 fix.go:55] fixHost starting: 

	I1231 11:22:34.434780    4432 cli_runner.go:133] Run: docker container inspect kubernetes-upgrade-20211231111918-1576 --format={{.State.Status}}

	I1231 11:22:30.593445    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.4246221s)

	I1231 11:22:30.596447    7616 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:30.597456    7616 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56202 <nil> <nil>}

	I1231 11:22:30.597456    7616 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\sstopped-upgrade-20211231111352-1576' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 stopped-upgrade-20211231111352-1576/g' /etc/hosts;

				else 

					echo '127.0.1.1 stopped-upgrade-20211231111352-1576' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1231 11:22:30.759928    7616 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1231 11:22:30.759928    7616 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube7\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube7\minikube-integration\.minikube}

	I1231 11:22:30.759928    7616 ubuntu.go:177] setting up certificates

	I1231 11:22:30.759928    7616 provision.go:83] configureAuth start

	I1231 11:22:30.765921    7616 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211231111352-1576

	I1231 11:22:32.257011    7616 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211231111352-1576: (1.4910838s)

	I1231 11:22:32.257011    7616 provision.go:138] copyHostCerts

	I1231 11:22:32.257654    7616 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem, removing ...

	I1231 11:22:32.257732    7616 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.pem

	I1231 11:22:32.257961    7616 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem (1082 bytes)

	I1231 11:22:32.259662    7616 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem, removing ...

	I1231 11:22:32.259662    7616 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cert.pem

	I1231 11:22:32.260158    7616 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem (1123 bytes)

	I1231 11:22:32.261678    7616 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem, removing ...

	I1231 11:22:32.261678    7616 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\key.pem

	I1231 11:22:32.261678    7616 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem (1679 bytes)

	I1231 11:22:32.263642    7616 provision.go:112] generating server cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.stopped-upgrade-20211231111352-1576 san=[172.17.0.2 127.0.0.1 localhost 127.0.0.1 minikube stopped-upgrade-20211231111352-1576]

	I1231 11:22:32.405853    7616 provision.go:172] copyRemoteCerts

	I1231 11:22:32.414858    7616 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1231 11:22:32.421868    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:33.794170    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.3722956s)

	I1231 11:22:33.794170    7616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56202 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\stopped-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:33.917691    7616 ssh_runner.go:235] Completed: sudo mkdir -p /etc/docker /etc/docker /etc/docker: (1.5028267s)

	I1231 11:22:33.918376    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1231 11:22:33.974737    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1277 bytes)

	I1231 11:22:34.021304    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1231 11:22:34.073529    7616 provision.go:86] duration metric: configureAuth took 3.3135865s

	I1231 11:22:34.073529    7616 ubuntu.go:193] setting minikube options for container-runtime

	I1231 11:22:34.073529    7616 config.go:176] Loaded profile config "stopped-upgrade-20211231111352-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I1231 11:22:34.079523    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:35.795125    4432 cli_runner.go:186] Completed: docker container inspect kubernetes-upgrade-20211231111918-1576 --format={{.State.Status}}: (1.3603394s)

	I1231 11:22:35.795125    4432 fix.go:108] recreateIfNeeded on kubernetes-upgrade-20211231111918-1576: state=Stopped err=<nil>

	W1231 11:22:35.795125    4432 fix.go:134] unexpected machine state, will restart: <nil>

	I1231 11:22:33.379141    6964 out.go:176]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1231 11:22:33.380150    6964 config.go:176] Loaded profile config "pause-20211231111903-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.1

	I1231 11:22:33.380150    6964 driver.go:344] Setting default libvirt URI to qemu:///system

	I1231 11:22:36.390741    6964 docker.go:132] docker version: linux-20.10.11

	I1231 11:22:36.398317    6964 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:22:38.877788    6964 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.4794608s)

	I1231 11:22:38.878689    6964 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:79 OomKillDisable:true NGoroutines:56 SystemTime:2021-12-31 11:22:37.7486746 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_

bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:22:35.799095    4432 out.go:176] * Restarting existing docker container for "kubernetes-upgrade-20211231111918-1576" ...

	I1231 11:22:35.804950    4432 cli_runner.go:133] Run: docker start kubernetes-upgrade-20211231111918-1576

	I1231 11:22:35.428238    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.3487095s)

	I1231 11:22:35.431501    7616 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:35.431501    7616 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56202 <nil> <nil>}

	I1231 11:22:35.431501    7616 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1231 11:22:35.606113    7616 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I1231 11:22:35.606113    7616 ubuntu.go:71] root file system type: overlay

	I1231 11:22:35.606113    7616 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1231 11:22:35.613101    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:37.071538    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.4584314s)

	I1231 11:22:37.074544    7616 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:37.074544    7616 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56202 <nil> <nil>}

	I1231 11:22:37.074544    7616 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1231 11:22:37.291110    7616 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1231 11:22:37.297098    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:38.714653    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.4175488s)

	I1231 11:22:38.717622    7616 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:38.717622    7616 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56202 <nil> <nil>}

	I1231 11:22:38.717622    7616 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1231 11:22:38.882202    6964 out.go:176] * Using the docker driver based on existing profile

	I1231 11:22:38.882279    6964 start.go:280] selected driver: docker

	I1231 11:22:38.882279    6964 start.go:795] validating driver "docker" against &{Name:pause-20211231111903-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.1 ClusterName:pause-20211231111903-1576 Namespace:default APIServerName:miniku

beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.23.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Moun

tOptions:[] MountPort:0 MountType:9p MountUID:docker}

	I1231 11:22:38.882279    6964 start.go:806] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I1231 11:22:38.882279    6964 start.go:1498] auto setting extra-config to "kubelet.global-housekeeping-interval=60m".

	I1231 11:22:38.882279    6964 start.go:1498] auto setting extra-config to "kubelet.housekeeping-interval=5m".

	I1231 11:22:38.908127    6964 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:22:41.327029    6964 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.4186983s)

	I1231 11:22:41.327244    6964 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:80 OomKillDisable:true NGoroutines:57 SystemTime:2021-12-31 11:22:40.2042358 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_

bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:22:41.379148    6964 cni.go:93] Creating CNI manager for ""

	I1231 11:22:41.379148    6964 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:22:41.379148    6964 start_flags.go:298] config:

	{Name:pause-20211231111903-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.1 ClusterName:pause-20211231111903-1576 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:

docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.23.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker}

	I1231 11:22:41.383165    6964 out.go:176] * Starting control plane node pause-20211231111903-1576 in cluster pause-20211231111903-1576

	I1231 11:22:41.383165    6964 cache.go:118] Beginning downloading kic base image for docker with docker

	I1231 11:22:42.068483   10208 out.go:203]   - Generating certificates and keys ...

	I1231 11:22:42.074477   10208 out.go:203]   - Booting up control plane ...

	I1231 11:22:41.386146    6964 out.go:176] * Pulling base image ...

	I1231 11:22:41.386146    6964 preload.go:132] Checking if preload exists for k8s version v1.23.1 and runtime docker

	I1231 11:22:41.386146    6964 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b in local docker daemon

	I1231 11:22:41.386146    6964 preload.go:148] Found local preload: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.1-docker-overlay2-amd64.tar.lz4

	I1231 11:22:41.386146    6964 cache.go:57] Caching tarball of preloaded images

	I1231 11:22:41.387153    6964 preload.go:174] Found C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1231 11:22:41.387153    6964 cache.go:60] Finished verifying existence of preloaded tar for  v1.23.1 on docker

	I1231 11:22:41.387153    6964 profile.go:147] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\config.json ...

	I1231 11:22:42.797711    6964 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b in local docker daemon, skipping pull

	I1231 11:22:42.797711    6964 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b exists in daemon, skipping load

	I1231 11:22:42.797711    6964 cache.go:206] Successfully downloaded all kic artifacts

	I1231 11:22:42.797711    6964 start.go:313] acquiring machines lock for pause-20211231111903-1576: {Name:mkd1ba6d04e1b7c72c7ae1ec3fb5922177e82911 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1231 11:22:42.797711    6964 start.go:317] acquired machines lock for "pause-20211231111903-1576" in 0s

	I1231 11:22:42.797711    6964 start.go:93] Skipping create...Using existing machine configuration

	I1231 11:22:42.797711    6964 fix.go:55] fixHost starting: 

	I1231 11:22:42.809709    6964 cli_runner.go:133] Run: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}

	I1231 11:22:42.079474   10208 out.go:203]   - Configuring RBAC rules ...

	I1231 11:22:42.083481   10208 cni.go:93] Creating CNI manager for ""

	I1231 11:22:42.083481   10208 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:22:42.083481   10208 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1231 11:22:42.096472   10208 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1231 11:22:42.098487   10208 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.0/kubectl label nodes minikube.k8s.io/version=v1.24.0 minikube.k8s.io/commit=a81813405fc4902e1caabd8d69223ec230d201fb minikube.k8s.io/name=running-upgrade-20211231111352-1576 minikube.k8s.io/updated_at=2021_12_31T11_22_42_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I1231 11:22:42.156308   10208 ops.go:34] apiserver oom_adj: -16

	I1231 11:22:42.765714   10208 kubeadm.go:864] duration metric: took 682.2299ms to wait for elevateKubeSystemPrivileges.

	I1231 11:22:42.765714   10208 kubeadm.go:390] StartCluster complete in 31.7846151s

	I1231 11:22:42.765714   10208 settings.go:142] acquiring lock: {Name:mk2f48f1c2db86c45c5c20d13312e07e9c171d09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:22:42.766732   10208 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 11:22:42.767730   10208 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:22:42.780714   10208 kapi.go:59] client config for running-upgrade-20211231111352-1576: &rest.Config{Host:"https://127.0.0.1:56017", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\running-upgrade-20211231111352-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\running-upgrade-20211231111352-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", Ce

rtData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:22:43.443850   10208 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "running-upgrade-20211231111352-1576" rescaled to 1

	I1231 11:22:43.444186   10208 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1231 11:22:43.444235   10208 start.go:206] Will wait 6m0s for node &{Name:m01 IP:172.17.0.3 Port:8443 KubernetesVersion:v1.18.0 ControlPlane:true Worker:true}

	I1231 11:22:44.289621    6964 cli_runner.go:186] Completed: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}: (1.4798513s)

	I1231 11:22:44.289621    6964 fix.go:108] recreateIfNeeded on pause-20211231111903-1576: state=Running err=<nil>

	W1231 11:22:44.289621    6964 fix.go:134] unexpected machine state, will restart: <nil>

	I1231 11:22:44.402592    4432 cli_runner.go:186] Completed: docker start kubernetes-upgrade-20211231111918-1576: (8.597606s)

	I1231 11:22:44.410587    4432 cli_runner.go:133] Run: docker container inspect kubernetes-upgrade-20211231111918-1576 --format={{.State.Status}}

	I1231 11:22:43.448214   10208 out.go:176] * Verifying Kubernetes components...

	I1231 11:22:43.444235   10208 addons.go:415] enableAddons start: toEnable=map[default-storageclass:true storage-provisioner:true], additional=[]

	I1231 11:22:43.444989   10208 config.go:176] Loaded profile config "running-upgrade-20211231111352-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I1231 11:22:43.448357   10208 addons.go:65] Setting storage-provisioner=true in profile "running-upgrade-20211231111352-1576"

	I1231 11:22:43.448357   10208 addons.go:65] Setting default-storageclass=true in profile "running-upgrade-20211231111352-1576"

	I1231 11:22:43.448357   10208 addons.go:153] Setting addon storage-provisioner=true in "running-upgrade-20211231111352-1576"

	W1231 11:22:43.448357   10208 addons.go:165] addon storage-provisioner should already be in state true

	I1231 11:22:43.448357   10208 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "running-upgrade-20211231111352-1576"

	I1231 11:22:43.448357   10208 host.go:66] Checking if "running-upgrade-20211231111352-1576" exists ...

	I1231 11:22:43.464086   10208 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1231 11:22:43.471094   10208 cli_runner.go:133] Run: docker container inspect running-upgrade-20211231111352-1576 --format={{.State.Status}}

	I1231 11:22:43.472081   10208 cli_runner.go:133] Run: docker container inspect running-upgrade-20211231111352-1576 --format={{.State.Status}}

	I1231 11:22:44.249106   10208 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.2 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1231 11:22:44.270004   10208 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" running-upgrade-20211231111352-1576

	I1231 11:22:45.096957   10208 cli_runner.go:186] Completed: docker container inspect running-upgrade-20211231111352-1576 --format={{.State.Status}}: (1.6258565s)

	I1231 11:22:45.101953   10208 out.go:176]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1231 11:22:45.101953   10208 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1231 11:22:45.101953   10208 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1231 11:22:45.112970   10208 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211231111352-1576

	I1231 11:22:45.123982   10208 cli_runner.go:186] Completed: docker container inspect running-upgrade-20211231111352-1576 --format={{.State.Status}}: (1.6518938s)

	I1231 11:22:45.125979   10208 kapi.go:59] client config for running-upgrade-20211231111352-1576: &rest.Config{Host:"https://127.0.0.1:56017", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\running-upgrade-20211231111352-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\running-upgrade-20211231111352-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", Ce

rtData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:22:45.160975   10208 addons.go:153] Setting addon default-storageclass=true in "running-upgrade-20211231111352-1576"

	W1231 11:22:45.161964   10208 addons.go:165] addon default-storageclass should already be in state true

	I1231 11:22:45.161964   10208 host.go:66] Checking if "running-upgrade-20211231111352-1576" exists ...

	I1231 11:22:45.178957   10208 cli_runner.go:133] Run: docker container inspect running-upgrade-20211231111352-1576 --format={{.State.Status}}

	I1231 11:22:45.673148   10208 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.2 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.4240361s)

	I1231 11:22:45.675151   10208 start.go:773] {"host.minikube.internal": 192.168.65.2} host record injected into CoreDNS

	I1231 11:22:44.293597    6964 out.go:176] * Updating the running docker "pause-20211231111903-1576" container ...

	I1231 11:22:44.293597    6964 machine.go:88] provisioning docker machine ...

	I1231 11:22:44.293597    6964 ubuntu.go:169] provisioning hostname "pause-20211231111903-1576"

	I1231 11:22:44.303646    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:46.107233    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.8035791s)

	I1231 11:22:46.111207    6964 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:46.112209    6964 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56091 <nil> <nil>}

	I1231 11:22:46.112209    6964 main.go:130] libmachine: About to run SSH command:

	sudo hostname pause-20211231111903-1576 && echo "pause-20211231111903-1576" | sudo tee /etc/hostname

	I1231 11:22:46.352563    6964 main.go:130] libmachine: SSH cmd err, output: <nil>: pause-20211231111903-1576

	I1231 11:22:46.365063    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:47.970388    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.6053178s)

	I1231 11:22:47.973367    6964 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:47.973367    6964 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56091 <nil> <nil>}

	I1231 11:22:47.973367    6964 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\spause-20211231111903-1576' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 pause-20211231111903-1576/g' /etc/hosts;

				else 

					echo '127.0.1.1 pause-20211231111903-1576' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1231 11:22:46.094238   10208 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" running-upgrade-20211231111352-1576: (1.8242263s)

	I1231 11:22:46.094238   10208 kubeadm.go:479] skip waiting for components based on config.

	I1231 11:22:46.094238   10208 node_conditions.go:102] verifying NodePressure condition ...

	I1231 11:22:46.125227   10208 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I1231 11:22:46.125227   10208 node_conditions.go:123] node cpu capacity is 16

	I1231 11:22:46.125227   10208 node_conditions.go:105] duration metric: took 30.9883ms to run NodePressure ...

	I1231 11:22:46.125227   10208 start.go:211] waiting for startup goroutines ...

	I1231 11:22:46.843687   10208 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211231111352-1576: (1.7307098s)

	I1231 11:22:46.843687   10208 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56015 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\running-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:46.894686   10208 cli_runner.go:186] Completed: docker container inspect running-upgrade-20211231111352-1576 --format={{.State.Status}}: (1.7157217s)

	I1231 11:22:46.894686   10208 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml

	I1231 11:22:46.894686   10208 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1231 11:22:46.901683   10208 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211231111352-1576

	I1231 11:22:47.009694   10208 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1231 11:22:48.472802   10208 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211231111352-1576: (1.5711125s)

	I1231 11:22:48.473515   10208 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56015 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\running-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:48.632995   10208 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1231 11:22:48.947955   10208 out.go:176] * Enabled addons: storage-provisioner, default-storageclass

	I1231 11:22:48.947955   10208 addons.go:417] enableAddons completed in 5.503697s

	I1231 11:22:49.145589   10208 start.go:493] kubectl: 1.18.2, cluster: 1.18.0 (minor skew: 0)

	I1231 11:22:49.149541   10208 out.go:176] * Done! kubectl is now configured to use "running-upgrade-20211231111352-1576" cluster and "" namespace by default

	I1231 11:22:46.202563    4432 cli_runner.go:186] Completed: docker container inspect kubernetes-upgrade-20211231111918-1576 --format={{.State.Status}}: (1.791968s)

	I1231 11:22:46.202563    4432 kic.go:420] container "kubernetes-upgrade-20211231111918-1576" state is running.

	I1231 11:22:46.213567    4432 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:47.834365    4432 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211231111918-1576: (1.6207913s)

	I1231 11:22:47.834365    4432 profile.go:147] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\config.json ...

	I1231 11:22:47.837382    4432 machine.go:88] provisioning docker machine ...

	I1231 11:22:47.837382    4432 ubuntu.go:169] provisioning hostname "kubernetes-upgrade-20211231111918-1576"

	I1231 11:22:47.843372    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:49.338540    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.4951613s)

	I1231 11:22:49.341544    4432 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:49.342541    4432 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56222 <nil> <nil>}

	I1231 11:22:49.342541    4432 main.go:130] libmachine: About to run SSH command:

	sudo hostname kubernetes-upgrade-20211231111918-1576 && echo "kubernetes-upgrade-20211231111918-1576" | sudo tee /etc/hostname

	I1231 11:22:45.540570    7616 main.go:130] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2021-12-31 11:16:45.568623600 +0000

	+++ /lib/systemd/system/docker.service.new	2021-12-31 11:22:37.248623600 +0000

	@@ -5,9 +5,12 @@

	 After=network-online.target firewalld.service containerd.service

	 Wants=network-online.target

	 Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	+Restart=on-failure

	@@ -23,7 +26,7 @@

	 # container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	 ExecStart=

	 ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	-ExecReload=/bin/kill -s HUP 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	I1231 11:22:45.540570    7616 machine.go:91] provisioned docker machine in 17.9656126s

	I1231 11:22:45.541559    7616 start.go:267] post-start starting for "stopped-upgrade-20211231111352-1576" (driver="docker")

	I1231 11:22:45.541559    7616 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1231 11:22:45.554566    7616 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1231 11:22:45.564553    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:47.249693    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.6851327s)

	I1231 11:22:47.250090    7616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56202 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\stopped-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:47.417404    7616 ssh_runner.go:235] Completed: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs: (1.8628309s)

	I1231 11:22:47.429393    7616 ssh_runner.go:195] Run: cat /etc/os-release

	I1231 11:22:47.444370    7616 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1231 11:22:47.444370    7616 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1231 11:22:47.444370    7616 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1231 11:22:47.444370    7616 info.go:137] Remote host: Ubuntu 19.10

	I1231 11:22:47.444370    7616 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\addons for local assets ...

	I1231 11:22:47.444370    7616 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\files for local assets ...

	I1231 11:22:47.446377    7616 filesync.go:149] local asset: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem -> 15762.pem in /etc/ssl/certs

	I1231 11:22:47.458391    7616 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1231 11:22:47.491371    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem --> /etc/ssl/certs/15762.pem (1708 bytes)

	I1231 11:22:47.545389    7616 start.go:270] post-start completed in 2.0038218s

	I1231 11:22:47.558380    7616 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1231 11:22:47.565377    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:49.048783    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.4834005s)

	I1231 11:22:49.048783    7616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56202 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\stopped-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:49.125569    7616 ssh_runner.go:235] Completed: sh -c "df -h /var | awk 'NR==2{print $5}'": (1.5671818s)

	I1231 11:22:49.125569    7616 fix.go:57] fixHost completed within 29.3720642s

	I1231 11:22:49.125569    7616 start.go:80] releasing machines lock for "stopped-upgrade-20211231111352-1576", held for 29.3720642s

	I1231 11:22:49.132553    7616 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211231111352-1576

	I1231 11:22:48.190948    6964 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1231 11:22:48.190948    6964 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube7\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube7\minikube-integration\.minikube}

	I1231 11:22:48.190948    6964 ubuntu.go:177] setting up certificates

	I1231 11:22:48.190948    6964 provision.go:83] configureAuth start

	I1231 11:22:48.199948    6964 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" pause-20211231111903-1576

	I1231 11:22:49.669546    6964 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" pause-20211231111903-1576: (1.4695917s)

	I1231 11:22:49.669546    6964 provision.go:138] copyHostCerts

	I1231 11:22:49.669546    6964 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem, removing ...

	I1231 11:22:49.669546    6964 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.pem

	I1231 11:22:49.669546    6964 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem (1082 bytes)

	I1231 11:22:49.670568    6964 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem, removing ...

	I1231 11:22:49.671537    6964 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cert.pem

	I1231 11:22:49.671537    6964 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem (1123 bytes)

	I1231 11:22:49.672535    6964 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem, removing ...

	I1231 11:22:49.672535    6964 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\key.pem

	I1231 11:22:49.672535    6964 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem (1679 bytes)

	I1231 11:22:49.673559    6964 provision.go:112] generating server cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.pause-20211231111903-1576 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube pause-20211231111903-1576]

	I1231 11:22:49.967393    6964 provision.go:172] copyRemoteCerts

	I1231 11:22:49.974406    6964 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1231 11:22:49.981388    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:51.437468    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.4559971s)

	I1231 11:22:51.439124    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:22:51.591341    6964 ssh_runner.go:235] Completed: sudo mkdir -p /etc/docker /etc/docker /etc/docker: (1.6159441s)

	I1231 11:22:51.592362    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1231 11:22:51.647405    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1249 bytes)

	I1231 11:22:51.709768    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1231 11:22:51.766474    6964 provision.go:86] duration metric: configureAuth took 3.5754519s

	I1231 11:22:51.766474    6964 ubuntu.go:193] setting minikube options for container-runtime

	I1231 11:22:51.767552    6964 config.go:176] Loaded profile config "pause-20211231111903-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.1

	I1231 11:22:51.778182    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:50.568718    7616 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211231111352-1576: (1.4361594s)

	I1231 11:22:50.570749    7616 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I1231 11:22:50.576710    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:50.577731    7616 ssh_runner.go:195] Run: systemctl --version

	I1231 11:22:50.583710    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:52.199158    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.6224415s)

	I1231 11:22:52.199158    7616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56202 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\stopped-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:52.203142    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.6194253s)

	I1231 11:22:52.203142    7616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56202 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\stopped-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:22:52.401908    7616 ssh_runner.go:235] Completed: curl -sS -m 2 https://k8s.gcr.io/: (1.8311518s)

	I1231 11:22:52.401908    7616 ssh_runner.go:235] Completed: systemctl --version: (1.8241697s)

	I1231 11:22:52.409897    7616 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1231 11:22:52.445915    7616 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1231 11:22:52.472894    7616 cruntime.go:264] skipping containerd shutdown because we are bound to it

	I1231 11:22:52.483911    7616 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1231 11:22:52.512881    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I1231 11:22:52.569893    7616 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1231 11:22:52.775892    7616 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1231 11:22:52.920907    7616 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1231 11:22:52.956914    7616 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1231 11:22:53.115911    7616 ssh_runner.go:195] Run: sudo systemctl start docker

	I1231 11:22:53.152914    7616 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1231 11:22:53.345836    7616 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1231 11:22:49.584548    4432 main.go:130] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-20211231111918-1576

	I1231 11:22:49.593563    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:51.019754    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.4261847s)

	I1231 11:22:51.022748    4432 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:51.023753    4432 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56222 <nil> <nil>}

	I1231 11:22:51.023753    4432 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\skubernetes-upgrade-20211231111918-1576' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kubernetes-upgrade-20211231111918-1576/g' /etc/hosts;

				else 

					echo '127.0.1.1 kubernetes-upgrade-20211231111918-1576' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1231 11:22:51.250944    4432 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1231 11:22:51.250944    4432 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube7\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube7\minikube-integration\.minikube}

	I1231 11:22:51.250944    4432 ubuntu.go:177] setting up certificates

	I1231 11:22:51.250944    4432 provision.go:83] configureAuth start

	I1231 11:22:51.263898    4432 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:52.899897    4432 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211231111918-1576: (1.6359916s)

	I1231 11:22:52.899897    4432 provision.go:138] copyHostCerts

	I1231 11:22:52.899897    4432 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem, removing ...

	I1231 11:22:52.899897    4432 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.pem

	I1231 11:22:52.899897    4432 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem (1082 bytes)

	I1231 11:22:52.901897    4432 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem, removing ...

	I1231 11:22:52.901897    4432 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cert.pem

	I1231 11:22:52.901897    4432 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem (1123 bytes)

	I1231 11:22:52.902915    4432 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem, removing ...

	I1231 11:22:52.902915    4432 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\key.pem

	I1231 11:22:52.903895    4432 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem (1679 bytes)

	I1231 11:22:52.904886    4432 provision.go:112] generating server cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.kubernetes-upgrade-20211231111918-1576 san=[192.168.58.2 127.0.0.1 localhost 127.0.0.1 minikube kubernetes-upgrade-20211231111918-1576]

	I1231 11:22:53.110877    4432 provision.go:172] copyRemoteCerts

	I1231 11:22:53.120890    4432 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1231 11:22:53.131877    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:53.471060    7616 out.go:203] * Preparing Kubernetes v1.18.0 on Docker 19.03.2 ...

	I1231 11:22:53.478084    7616 cli_runner.go:133] Run: docker exec -t stopped-upgrade-20211231111352-1576 dig +short host.docker.internal

	I1231 11:22:55.496399    7616 cli_runner.go:186] Completed: docker exec -t stopped-upgrade-20211231111352-1576 dig +short host.docker.internal: (2.0183073s)

	I1231 11:22:55.496399    7616 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2

	I1231 11:22:55.506392    7616 ssh_runner.go:195] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I1231 11:22:55.518401    7616 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1231 11:22:55.565414    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:22:57.098107    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.5326864s)

	I1231 11:22:53.367833    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.5896447s)

	I1231 11:22:53.370839    6964 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:53.371847    6964 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56091 <nil> <nil>}

	I1231 11:22:53.371847    6964 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1231 11:22:53.569118    6964 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I1231 11:22:53.569118    6964 ubuntu.go:71] root file system type: overlay

	I1231 11:22:53.570071    6964 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1231 11:22:53.578077    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:55.151001    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.5729178s)

	I1231 11:22:55.154990    6964 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:55.154990    6964 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56091 <nil> <nil>}

	I1231 11:22:55.154990    6964 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1231 11:22:55.457404    6964 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1231 11:22:55.463392    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:57.002836    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.5394377s)

	I1231 11:22:57.007844    6964 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:57.007844    6964 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56091 <nil> <nil>}

	I1231 11:22:57.007844    6964 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1231 11:22:57.245110    6964 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1231 11:22:57.245110    6964 machine.go:91] provisioned docker machine in 12.9514587s

	I1231 11:22:57.245110    6964 start.go:267] post-start starting for "pause-20211231111903-1576" (driver="docker")

	I1231 11:22:57.245110    6964 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1231 11:22:57.263115    6964 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1231 11:22:57.278120    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:22:54.700209    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.5683253s)

	I1231 11:22:54.700484    4432 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56222 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\kubernetes-upgrade-20211231111918-1576\id_rsa Username:docker}

	I1231 11:22:54.851920    4432 ssh_runner.go:235] Completed: sudo mkdir -p /etc/docker /etc/docker /etc/docker: (1.7310229s)

	I1231 11:22:54.851920    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1231 11:22:54.911919    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1285 bytes)

	I1231 11:22:54.962928    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1231 11:22:55.016926    4432 provision.go:86] duration metric: configureAuth took 3.7659657s

	I1231 11:22:55.016926    4432 ubuntu.go:193] setting minikube options for container-runtime

	I1231 11:22:55.017921    4432 config.go:176] Loaded profile config "kubernetes-upgrade-20211231111918-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.2-rc.0

	I1231 11:22:55.022928    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:56.558878    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.5359444s)

	I1231 11:22:56.563875    4432 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:56.564864    4432 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56222 <nil> <nil>}

	I1231 11:22:56.564864    4432 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1231 11:22:56.778822    4432 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I1231 11:22:56.778822    4432 ubuntu.go:71] root file system type: overlay

	I1231 11:22:56.779832    4432 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1231 11:22:56.787843    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:58.346076    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.5582264s)

	I1231 11:22:58.349733    4432 main.go:130] libmachine: Using SSH client type: native

	I1231 11:22:58.349927    4432 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56222 <nil> <nil>}

	I1231 11:22:58.349927    4432 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1231 11:22:58.690992    4432 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1231 11:22:58.702968    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:22:57.103112    7616 out.go:176]   - kubeadm.pod-network-cidr=10.244.0.0/16

	I1231 11:22:57.103112    7616 preload.go:132] Checking if preload exists for k8s version v1.18.0 and runtime docker

	I1231 11:22:57.110204    7616 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1231 11:22:57.220105    7616 docker.go:581] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-proxy:v1.18.0

	k8s.gcr.io/kube-scheduler:v1.18.0

	k8s.gcr.io/kube-controller-manager:v1.18.0

	k8s.gcr.io/kube-apiserver:v1.18.0

	kubernetesui/dashboard:v2.0.0-rc6

	k8s.gcr.io/pause:3.2

	k8s.gcr.io/coredns:1.6.7

	kindest/kindnetd:0.5.3

	k8s.gcr.io/etcd:3.4.3-0

	kubernetesui/metrics-scraper:v1.0.2

	gcr.io/k8s-minikube/storage-provisioner:v1.8.1

	-- /stdout --

	I1231 11:22:57.220105    7616 docker.go:587] gcr.io/k8s-minikube/storage-provisioner:v5 wasn't preloaded

	I1231 11:22:57.220105    7616 cache_images.go:88] LoadImages start: [k8s.gcr.io/kube-apiserver:v1.18.0 k8s.gcr.io/kube-controller-manager:v1.18.0 k8s.gcr.io/kube-scheduler:v1.18.0 k8s.gcr.io/kube-proxy:v1.18.0 k8s.gcr.io/pause:3.2 k8s.gcr.io/etcd:3.4.3-0 k8s.gcr.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5 docker.io/kubernetesui/dashboard:v2.3.1 docker.io/kubernetesui/metrics-scraper:v1.0.7]

	I1231 11:22:57.248122    7616 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1231 11:22:57.255156    7616 image.go:134] retrieving image: k8s.gcr.io/kube-apiserver:v1.18.0

	I1231 11:22:57.267133    7616 image.go:134] retrieving image: docker.io/kubernetesui/dashboard:v2.3.1

	I1231 11:22:57.270144    7616 image.go:134] retrieving image: k8s.gcr.io/kube-controller-manager:v1.18.0

	I1231 11:22:57.272110    7616 image.go:180] daemon lookup for k8s.gcr.io/kube-apiserver:v1.18.0: Error response from daemon: reference does not exist

	I1231 11:22:57.279133    7616 image.go:134] retrieving image: k8s.gcr.io/coredns:1.6.7

	I1231 11:22:57.282128    7616 image.go:134] retrieving image: k8s.gcr.io/kube-scheduler:v1.18.0

	I1231 11:22:57.289120    7616 image.go:180] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: reference does not exist

	I1231 11:22:57.293147    7616 image.go:134] retrieving image: k8s.gcr.io/kube-proxy:v1.18.0

	I1231 11:22:57.302109    7616 image.go:180] daemon lookup for k8s.gcr.io/coredns:1.6.7: Error response from daemon: reference does not exist

	I1231 11:22:57.306126    7616 image.go:180] daemon lookup for docker.io/kubernetesui/dashboard:v2.3.1: Error response from daemon: reference does not exist

	I1231 11:22:57.313171    7616 image.go:180] daemon lookup for k8s.gcr.io/kube-scheduler:v1.18.0: Error response from daemon: reference does not exist

	I1231 11:22:57.323143    7616 image.go:134] retrieving image: docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1231 11:22:57.332114    7616 image.go:134] retrieving image: k8s.gcr.io/pause:3.2

	I1231 11:22:57.333134    7616 image.go:180] daemon lookup for docker.io/kubernetesui/metrics-scraper:v1.0.7: Error response from daemon: reference does not exist

	I1231 11:22:57.355116    7616 image.go:180] daemon lookup for k8s.gcr.io/kube-proxy:v1.18.0: Error response from daemon: reference does not exist

	I1231 11:22:57.365122    7616 image.go:180] daemon lookup for k8s.gcr.io/pause:3.2: Error response from daemon: reference does not exist

	I1231 11:22:57.379119    7616 image.go:180] daemon lookup for k8s.gcr.io/kube-controller-manager:v1.18.0: Error response from daemon: reference does not exist

	I1231 11:22:57.385115    7616 image.go:134] retrieving image: k8s.gcr.io/etcd:3.4.3-0

	I1231 11:22:57.394129    7616 image.go:180] daemon lookup for k8s.gcr.io/etcd:3.4.3-0: Error response from daemon: reference does not exist

	W1231 11:22:57.635418    7616 image.go:190] authn lookup for k8s.gcr.io/kube-apiserver:v1.18.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:22:57.813595    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/kube-apiserver:v1.18.0

	W1231 11:22:57.952049    7616 image.go:190] authn lookup for gcr.io/k8s-minikube/storage-provisioner:v5 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:22:58.162526    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5

	I1231 11:22:58.268444    7616 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime

	I1231 11:22:58.268444    7616 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner:v5 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v5

	I1231 11:22:58.268444    7616 docker.go:262] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5

	W1231 11:22:58.273452    7616 image.go:190] authn lookup for k8s.gcr.io/coredns:1.6.7 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:22:58.278436    7616 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5

	I1231 11:22:58.374941    7616 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v5

	I1231 11:22:58.382957    7616 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5

	I1231 11:22:58.393944    7616 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory

	I1231 11:22:58.393944    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (9060352 bytes)

	I1231 11:22:58.435989    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/coredns:1.6.7

	W1231 11:22:58.621953    7616 image.go:190] authn lookup for docker.io/kubernetesui/dashboard:v2.3.1 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	W1231 11:22:59.008954    7616 image.go:190] authn lookup for k8s.gcr.io/kube-scheduler:v1.18.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:22:59.008954    7616 docker.go:229] Loading image: /var/lib/minikube/images/storage-provisioner_v5

	I1231 11:22:59.008954    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/storage-provisioner_v5 | docker load"

	I1231 11:22:59.172356    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/kube-scheduler:v1.18.0

	I1231 11:22:59.233307    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} docker.io/kubernetesui/dashboard:v2.3.1

	W1231 11:22:59.375832    7616 image.go:190] authn lookup for docker.io/kubernetesui/metrics-scraper:v1.0.7 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:22:59.702282    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} docker.io/kubernetesui/metrics-scraper:v1.0.7

	W1231 11:22:59.730294    7616 image.go:190] authn lookup for k8s.gcr.io/kube-proxy:v1.18.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:22:59.891972    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/kube-proxy:v1.18.0

	I1231 11:22:58.869983    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.5918571s)

	I1231 11:22:58.869983    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:22:59.015957    6964 ssh_runner.go:235] Completed: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs: (1.7518002s)

	I1231 11:22:59.025942    6964 ssh_runner.go:195] Run: cat /etc/os-release

	I1231 11:22:59.035956    6964 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1231 11:22:59.035956    6964 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1231 11:22:59.035956    6964 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1231 11:22:59.035956    6964 info.go:137] Remote host: Ubuntu 20.04.2 LTS

	I1231 11:22:59.035956    6964 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\addons for local assets ...

	I1231 11:22:59.036952    6964 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\files for local assets ...

	I1231 11:22:59.038955    6964 filesync.go:149] local asset: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem -> 15762.pem in /etc/ssl/certs

	I1231 11:22:59.054988    6964 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1231 11:22:59.082952    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem --> /etc/ssl/certs/15762.pem (1708 bytes)

	I1231 11:22:59.134144    6964 start.go:270] post-start completed in 1.8890259s

	I1231 11:22:59.148306    6964 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1231 11:22:59.157325    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:00.804999    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.6476666s)

	I1231 11:23:00.804999    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:23:00.955603    6964 ssh_runner.go:235] Completed: sh -c "df -h /var | awk 'NR==2{print $5}'": (1.8072896s)

	I1231 11:23:00.955603    6964 fix.go:57] fixHost completed within 18.1578155s

	I1231 11:23:00.955603    6964 start.go:80] releasing machines lock for "pause-20211231111903-1576", held for 18.1578155s

	I1231 11:23:00.962587    6964 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" pause-20211231111903-1576

	I1231 11:23:02.626605    6964 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" pause-20211231111903-1576: (1.6640114s)

	I1231 11:23:02.629587    6964 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I1231 11:23:02.640576    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:02.642579    6964 ssh_runner.go:195] Run: systemctl --version

	I1231 11:23:02.652579    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:00.376902    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.6739273s)

	I1231 11:23:00.380354    4432 main.go:130] libmachine: Using SSH client type: native

	I1231 11:23:00.380952    4432 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x729ec0] 0x72cd80 <nil>  [] 0s} 127.0.0.1 56222 <nil> <nil>}

	I1231 11:23:00.380952    4432 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1231 11:23:00.599443    4432 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1231 11:23:00.599443    4432 machine.go:91] provisioned docker machine in 12.7620076s

	I1231 11:23:00.599443    4432 start.go:267] post-start starting for "kubernetes-upgrade-20211231111918-1576" (driver="docker")

	I1231 11:23:00.599443    4432 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1231 11:23:00.608461    4432 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1231 11:23:00.616454    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:23:02.291586    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.6751251s)

	I1231 11:23:02.291586    4432 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56222 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\kubernetes-upgrade-20211231111918-1576\id_rsa Username:docker}

	I1231 11:23:02.494623    4432 ssh_runner.go:235] Completed: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs: (1.8861541s)

	I1231 11:23:02.506593    4432 ssh_runner.go:195] Run: cat /etc/os-release

	I1231 11:23:02.520578    4432 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1231 11:23:02.520578    4432 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1231 11:23:02.520578    4432 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1231 11:23:02.520578    4432 info.go:137] Remote host: Ubuntu 20.04.2 LTS

	I1231 11:23:02.520578    4432 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\addons for local assets ...

	I1231 11:23:02.520578    4432 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\files for local assets ...

	I1231 11:23:02.522612    4432 filesync.go:149] local asset: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem -> 15762.pem in /etc/ssl/certs

	I1231 11:23:02.533586    4432 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1231 11:23:02.564582    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem --> /etc/ssl/certs/15762.pem (1708 bytes)

	I1231 11:23:02.634586    4432 start.go:270] post-start completed in 2.0351345s

	I1231 11:23:02.649575    4432 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1231 11:23:02.659575    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:23:04.423849    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.7642664s)

	I1231 11:23:04.423849    4432 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56222 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\kubernetes-upgrade-20211231111918-1576\id_rsa Username:docker}

	W1231 11:23:00.119624    7616 image.go:190] authn lookup for k8s.gcr.io/pause:3.2 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:23:00.315268    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/pause:3.2

	W1231 11:23:00.482934    7616 image.go:190] authn lookup for k8s.gcr.io/kube-controller-manager:v1.18.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:23:00.649103    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/kube-controller-manager:v1.18.0

	I1231 11:23:00.801005    7616 ssh_runner.go:235] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/storage-provisioner_v5 | docker load": (1.7920427s)

	I1231 11:23:00.801005    7616 cache_images.go:315] Transferred and loaded C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v5 from cache

	I1231 11:23:00.801005    7616 ssh_runner.go:235] Completed: docker image inspect --format {{.Id}} k8s.gcr.io/kube-scheduler:v1.18.0: (1.6286415s)

	I1231 11:23:00.801005    7616 ssh_runner.go:235] Completed: docker image inspect --format {{.Id}} docker.io/kubernetesui/dashboard:v2.3.1: (1.5666906s)

	I1231 11:23:00.801005    7616 ssh_runner.go:235] Completed: docker image inspect --format {{.Id}} docker.io/kubernetesui/metrics-scraper:v1.0.7: (1.0987182s)

	I1231 11:23:00.801005    7616 cache_images.go:116] "docker.io/kubernetesui/dashboard:v2.3.1" needs transfer: "docker.io/kubernetesui/dashboard:v2.3.1" does not exist at hash "e1482a24335a6e76d438ae175f79409004588570d3e5dbb4c8140e025e848570" in container runtime

	I1231 11:23:00.801005    7616 cache_images.go:116] "docker.io/kubernetesui/metrics-scraper:v1.0.7" needs transfer: "docker.io/kubernetesui/metrics-scraper:v1.0.7" does not exist at hash "7801cfc6d5c072eb114355d369c830641064a246b5a774bcd668fac75ec728e9" in container runtime

	I1231 11:23:00.801005    7616 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\dashboard:v2.3.1 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\dashboard_v2.3.1

	I1231 11:23:00.801005    7616 docker.go:262] Removing image: docker.io/kubernetesui/dashboard:v2.3.1

	I1231 11:23:00.801005    7616 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\metrics-scraper:v1.0.7 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\metrics-scraper_v1.0.7

	I1231 11:23:00.801005    7616 docker.go:262] Removing image: docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1231 11:23:00.809015    7616 ssh_runner.go:195] Run: docker rmi docker.io/kubernetesui/dashboard:v2.3.1

	I1231 11:23:00.809015    7616 ssh_runner.go:195] Run: docker rmi docker.io/kubernetesui/metrics-scraper:v1.0.7

	W1231 11:23:00.820033    7616 image.go:190] authn lookup for k8s.gcr.io/etcd:3.4.3-0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1231 11:23:00.946973    7616 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\dashboard_v2.3.1

	I1231 11:23:00.947122    7616 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\metrics-scraper_v1.0.7

	I1231 11:23:00.962587    7616 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.7

	I1231 11:23:00.962587    7616 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.3.1

	I1231 11:23:00.973569    7616 ssh_runner.go:352] existence check for /var/lib/minikube/images/dashboard_v2.3.1: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.3.1: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/dashboard_v2.3.1': No such file or directory

	I1231 11:23:00.973569    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\dashboard_v2.3.1 --> /var/lib/minikube/images/dashboard_v2.3.1 (66936320 bytes)

	I1231 11:23:00.973569    7616 ssh_runner.go:352] existence check for /var/lib/minikube/images/metrics-scraper_v1.0.7: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.7: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/metrics-scraper_v1.0.7': No such file or directory

	I1231 11:23:00.974569    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\metrics-scraper_v1.0.7 --> /var/lib/minikube/images/metrics-scraper_v1.0.7 (15031296 bytes)

	I1231 11:23:00.989589    7616 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} k8s.gcr.io/etcd:3.4.3-0

	I1231 11:23:02.826590    7616 docker.go:229] Loading image: /var/lib/minikube/images/metrics-scraper_v1.0.7

	I1231 11:23:02.826590    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/metrics-scraper_v1.0.7 | docker load"

	I1231 11:23:04.424859    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.7712486s)

	I1231 11:23:04.425860    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:23:04.433842    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.7932585s)

	I1231 11:23:04.433842    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:23:04.572852    6964 ssh_runner.go:235] Completed: systemctl --version: (1.930265s)

	I1231 11:23:04.590858    6964 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1231 11:23:04.687890    6964 ssh_runner.go:235] Completed: curl -sS -m 2 https://k8s.gcr.io/: (2.0582947s)

	I1231 11:23:04.700850    6964 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1231 11:23:04.737846    6964 cruntime.go:264] skipping containerd shutdown because we are bound to it

	I1231 11:23:04.747849    6964 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1231 11:23:04.775855    6964 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I1231 11:23:04.837847    6964 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1231 11:23:05.134848    6964 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1231 11:23:05.368862    6964 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1231 11:23:05.404844    6964 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1231 11:23:05.657813    6964 ssh_runner.go:195] Run: sudo systemctl start docker

	I1231 11:23:05.697806    6964 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1231 11:23:05.890816    6964 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1231 11:23:06.018810    6964 out.go:203] * Preparing Kubernetes v1.23.1 on Docker 20.10.12 ...

	I1231 11:23:06.027831    6964 cli_runner.go:133] Run: docker exec -t pause-20211231111903-1576 dig +short host.docker.internal

	I1231 11:23:07.972123    6964 cli_runner.go:186] Completed: docker exec -t pause-20211231111903-1576 dig +short host.docker.internal: (1.9441259s)

	I1231 11:23:07.972218    6964 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2

	I1231 11:23:07.982904    6964 ssh_runner.go:195] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I1231 11:23:07.999582    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:04.578916    4432 ssh_runner.go:235] Completed: sh -c "df -h /var | awk 'NR==2{print $5}'": (1.9293335s)

	I1231 11:23:04.582857    4432 fix.go:57] fixHost completed within 30.1596166s

	I1231 11:23:04.582857    4432 start.go:80] releasing machines lock for "kubernetes-upgrade-20211231111918-1576", held for 30.1596166s

	I1231 11:23:04.593866    4432 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211231111918-1576

	I1231 11:23:06.124126    4432 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211231111918-1576: (1.5302538s)

	I1231 11:23:06.126151    4432 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I1231 11:23:06.132135    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:23:06.135138    4432 ssh_runner.go:195] Run: systemctl --version

	I1231 11:23:06.144121    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:23:07.566599    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.4224712s)

	I1231 11:23:07.566599    4432 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56222 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\kubernetes-upgrade-20211231111918-1576\id_rsa Username:docker}

	I1231 11:23:07.567588    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.4354468s)

	I1231 11:23:07.567588    4432 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56222 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\kubernetes-upgrade-20211231111918-1576\id_rsa Username:docker}

	I1231 11:23:07.880379    4432 ssh_runner.go:235] Completed: curl -sS -m 2 https://k8s.gcr.io/: (1.7542211s)

	I1231 11:23:07.880379    4432 ssh_runner.go:235] Completed: systemctl --version: (1.7452338s)

	I1231 11:23:07.892351    4432 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1231 11:23:07.945974    4432 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1231 11:23:07.977902    4432 cruntime.go:264] skipping containerd shutdown because we are bound to it

	I1231 11:23:07.986920    4432 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1231 11:23:08.011531    4432 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I1231 11:23:08.063543    4432 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1231 11:23:08.242940    4432 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1231 11:23:08.397240    4432 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1231 11:23:08.437581    4432 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1231 11:23:08.608812    4432 ssh_runner.go:195] Run: sudo systemctl start docker

	I1231 11:23:08.645820    4432 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1231 11:23:08.752990    4432 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1231 11:23:09.405917    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.4062948s)

	I1231 11:23:09.410181    6964 out.go:176]   - kubelet.global-housekeeping-interval=60m

	I1231 11:23:08.854591    4432 out.go:203] * Preparing Kubernetes v1.23.2-rc.0 on Docker 20.10.12 ...

	I1231 11:23:08.861610    4432 cli_runner.go:133] Run: docker exec -t kubernetes-upgrade-20211231111918-1576 dig +short host.docker.internal

	I1231 11:23:06.057138    7616 ssh_runner.go:235] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/metrics-scraper_v1.0.7 | docker load": (3.2305342s)

	I1231 11:23:06.057138    7616 cache_images.go:315] Transferred and loaded C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\metrics-scraper_v1.0.7 from cache

	I1231 11:23:06.057138    7616 docker.go:229] Loading image: /var/lib/minikube/images/dashboard_v2.3.1

	I1231 11:23:06.057138    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/dashboard_v2.3.1 | docker load"

	I1231 11:23:10.742348    4432 cli_runner.go:186] Completed: docker exec -t kubernetes-upgrade-20211231111918-1576 dig +short host.docker.internal: (1.8807301s)

	I1231 11:23:10.742348    4432 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2

	I1231 11:23:10.752354    4432 ssh_runner.go:195] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I1231 11:23:10.764348    4432 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1231 11:23:10.799365    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:23:12.202482    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.4021162s)

	I1231 11:23:12.206490    4432 out.go:176]   - kubelet.global-housekeeping-interval=60m

	I1231 11:23:09.412189    6964 out.go:176]   - kubelet.housekeeping-interval=5m

	I1231 11:23:09.413195    6964 preload.go:132] Checking if preload exists for k8s version v1.23.1 and runtime docker

	I1231 11:23:09.418180    6964 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1231 11:23:09.508060    6964 docker.go:581] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.23.1

	k8s.gcr.io/kube-proxy:v1.23.1

	k8s.gcr.io/kube-scheduler:v1.23.1

	k8s.gcr.io/kube-controller-manager:v1.23.1

	k8s.gcr.io/etcd:3.5.1-0

	k8s.gcr.io/coredns/coredns:v1.8.6

	k8s.gcr.io/pause:3.6

	kubernetesui/dashboard:v2.3.1

	kubernetesui/metrics-scraper:v1.0.7

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1231 11:23:09.508125    6964 docker.go:512] Images already preloaded, skipping extraction

	I1231 11:23:09.518104    6964 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1231 11:23:09.616703    6964 docker.go:581] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.23.1

	k8s.gcr.io/kube-proxy:v1.23.1

	k8s.gcr.io/kube-scheduler:v1.23.1

	k8s.gcr.io/kube-controller-manager:v1.23.1

	k8s.gcr.io/etcd:3.5.1-0

	k8s.gcr.io/coredns/coredns:v1.8.6

	k8s.gcr.io/pause:3.6

	kubernetesui/dashboard:v2.3.1

	kubernetesui/metrics-scraper:v1.0.7

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1231 11:23:09.616703    6964 cache_images.go:84] Images are preloaded, skipping loading

	I1231 11:23:09.622723    6964 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1231 11:23:09.867055    6964 cni.go:93] Creating CNI manager for ""

	I1231 11:23:09.867055    6964 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:23:09.867055    6964 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1231 11:23:09.867055    6964 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.23.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:pause-20211231111903-1576 NodeName:pause-20211231111903-1576 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/mini

kube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I1231 11:23:09.868059    6964 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "pause-20211231111903-1576"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.23.1

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1231 11:23:09.868059    6964 kubeadm.go:788] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.23.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --global-housekeeping-interval=60m --hostname-override=pause-20211231111903-1576 --housekeeping-interval=5m --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.23.1 ClusterName:pause-20211231111903-1576 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1231 11:23:09.880044    6964 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.23.1

	I1231 11:23:09.903052    6964 binaries.go:44] Found k8s binaries, skipping transfer

	I1231 11:23:09.913056    6964 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1231 11:23:09.938065    6964 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (413 bytes)

	I1231 11:23:09.976054    6964 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1231 11:23:10.014055    6964 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2068 bytes)

	I1231 11:23:10.069066    6964 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I1231 11:23:10.079078    6964 certs.go:54] Setting up C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576 for IP: 192.168.49.2

	I1231 11:23:10.079078    6964 certs.go:182] skipping minikubeCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key

	I1231 11:23:10.080061    6964 certs.go:182] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key

	I1231 11:23:10.080061    6964 certs.go:298] skipping minikube-user signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\client.key

	I1231 11:23:10.081071    6964 certs.go:298] skipping minikube signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\apiserver.key.dd3b5fb2

	I1231 11:23:10.081071    6964 certs.go:298] skipping aggregator signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\proxy-client.key

	I1231 11:23:10.082059    6964 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576.pem (1338 bytes)

	W1231 11:23:10.083072    6964 certs.go:384] ignoring C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576_empty.pem, impossibly tiny 0 bytes

	I1231 11:23:10.083072    6964 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem (1679 bytes)

	I1231 11:23:10.083072    6964 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem (1082 bytes)

	I1231 11:23:10.083072    6964 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I1231 11:23:10.083072    6964 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I1231 11:23:10.084054    6964 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem (1708 bytes)

	I1231 11:23:10.086054    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1231 11:23:10.140058    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I1231 11:23:10.194065    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1231 11:23:10.242054    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\pause-20211231111903-1576\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I1231 11:23:10.295058    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1231 11:23:10.350968    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1231 11:23:10.407689    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1231 11:23:10.461121    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1231 11:23:10.523812    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem --> /usr/share/ca-certificates/15762.pem (1708 bytes)

	I1231 11:23:10.633956    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1231 11:23:10.699901    6964 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576.pem --> /usr/share/ca-certificates/1576.pem (1338 bytes)

	I1231 11:23:10.751357    6964 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1231 11:23:10.801360    6964 ssh_runner.go:195] Run: openssl version

	I1231 11:23:10.826357    6964 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1231 11:23:10.863354    6964 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:23:10.875356    6964 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Dec 31 09:49 /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:23:10.883350    6964 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:23:10.906352    6964 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1231 11:23:10.934366    6964 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1576.pem && ln -fs /usr/share/ca-certificates/1576.pem /etc/ssl/certs/1576.pem"

	I1231 11:23:10.962615    6964 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1576.pem

	I1231 11:23:10.973620    6964 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Dec 31 10:02 /usr/share/ca-certificates/1576.pem

	I1231 11:23:10.981619    6964 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1576.pem

	I1231 11:23:11.001607    6964 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1576.pem /etc/ssl/certs/51391683.0"

	I1231 11:23:11.032600    6964 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15762.pem && ln -fs /usr/share/ca-certificates/15762.pem /etc/ssl/certs/15762.pem"

	I1231 11:23:11.064601    6964 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15762.pem

	I1231 11:23:11.075616    6964 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Dec 31 10:02 /usr/share/ca-certificates/15762.pem

	I1231 11:23:11.084614    6964 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15762.pem

	I1231 11:23:11.106618    6964 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/15762.pem /etc/ssl/certs/3ec20f2e.0"

	I1231 11:23:11.128629    6964 kubeadm.go:388] StartCluster: {Name:pause-20211231111903-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.1 ClusterName:pause-20211231111903-1576 Namespace:default APIServerName:minikubeCA APIServerNames:

[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.23.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPor

t:0 MountType:9p MountUID:docker}

	I1231 11:23:11.134634    6964 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1231 11:23:11.212449    6964 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1231 11:23:11.250890    6964 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1231 11:23:11.275889    6964 kubeadm.go:124] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1231 11:23:11.281898    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:12.746481    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.4645768s)

	I1231 11:23:12.748525    6964 kubeconfig.go:92] found "pause-20211231111903-1576" server: "https://127.0.0.1:56090"

	I1231 11:23:12.750499    6964 kapi.go:59] client config for pause-20211231111903-1576: &rest.Config{Host:"https://127.0.0.1:56090", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\pause-20211231111903-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\pause-20211231111903-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", CertData:[]uint8(nil), KeyData:[

]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:23:12.787484    6964 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1231 11:23:12.817500    6964 api_server.go:165] Checking apiserver status ...

	I1231 11:23:12.828489    6964 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1231 11:23:12.896484    6964 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1802/cgroup

	I1231 11:23:12.925512    6964 api_server.go:181] apiserver freezer: "20:freezer:/docker/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939/kubepods/burstable/pod61a858f6d0a505095df4f4e361b4fe99/0312af21019e02a88370acf826c837f9b955afc8956e8a5ae575837e9a5ffa52"

	I1231 11:23:12.934483    6964 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/1c4b9f54092fd06da6a2d29393bffce934a6534018076fb1c9b311b8fc40c939/kubepods/burstable/pod61a858f6d0a505095df4f4e361b4fe99/0312af21019e02a88370acf826c837f9b955afc8956e8a5ae575837e9a5ffa52/freezer.state

	I1231 11:23:12.961490    6964 api_server.go:203] freezer state: "THAWED"

	I1231 11:23:12.961490    6964 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:56090/healthz ...

	I1231 11:23:12.208494    4432 out.go:176]   - kubelet.housekeeping-interval=5m

	I1231 11:23:12.209481    4432 preload.go:132] Checking if preload exists for k8s version v1.23.2-rc.0 and runtime docker

	I1231 11:23:12.215487    4432 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1231 11:23:12.334486    4432 docker.go:581] Got preloaded images: -- stdout --

	kubernetesui/dashboard:v2.3.1

	kubernetesui/metrics-scraper:v1.0.7

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/kube-apiserver:v1.16.0

	k8s.gcr.io/kube-proxy:v1.16.0

	k8s.gcr.io/kube-controller-manager:v1.16.0

	k8s.gcr.io/kube-scheduler:v1.16.0

	k8s.gcr.io/etcd:3.3.15-0

	k8s.gcr.io/coredns:1.6.2

	k8s.gcr.io/pause:3.1

	-- /stdout --

	I1231 11:23:12.334486    4432 docker.go:587] k8s.gcr.io/kube-apiserver:v1.23.2-rc.0 wasn't preloaded

	I1231 11:23:12.349494    4432 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1231 11:23:12.390492    4432 ssh_runner.go:195] Run: which lz4

	I1231 11:23:12.411509    4432 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I1231 11:23:12.424489    4432 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/preloaded.tar.lz4': No such file or directory

	I1231 11:23:12.424489    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.2-rc.0-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (528915498 bytes)

	I1231 11:23:14.981508    6964 api_server.go:266] https://127.0.0.1:56090/healthz returned 500:

	[+]ping ok

	[+]log ok

	[-]etcd failed: reason withheld

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/rbac/bootstrap-roles ok

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I1231 11:23:14.982503    6964 retry.go:31] will retry after 263.082536ms: https://127.0.0.1:56090/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[-]etcd failed: reason withheld

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/rbac/bootstrap-roles ok

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I1231 11:23:15.247494    6964 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:56090/healthz ...

	I1231 11:23:15.671552    6964 api_server.go:266] https://127.0.0.1:56090/healthz returned 200:

	ok

	I1231 11:23:15.710501    6964 system_pods.go:86] 6 kube-system pods found

	I1231 11:23:15.711507    6964 system_pods.go:89] "coredns-64897985d-rv9pb" [dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f] Running

	I1231 11:23:15.711507    6964 system_pods.go:89] "etcd-pause-20211231111903-1576" [72622213-821c-4658-9a71-8bd85c7ea55a] Running

	I1231 11:23:15.711507    6964 system_pods.go:89] "kube-apiserver-pause-20211231111903-1576" [0adf54cf-fd98-48c8-8c15-e202982b2f91] Running

	I1231 11:23:15.711507    6964 system_pods.go:89] "kube-controller-manager-pause-20211231111903-1576" [c8852535-307d-4b94-b74d-1fabe79c458d] Running

	I1231 11:23:15.711507    6964 system_pods.go:89] "kube-proxy-zqfxj" [1825a520-13e0-4474-a4e0-67a41d7c78c6] Running

	I1231 11:23:15.711507    6964 system_pods.go:89] "kube-scheduler-pause-20211231111903-1576" [1586a2e1-06da-42a9-8af1-4f8a13373bbc] Running

	I1231 11:23:15.715529    6964 api_server.go:140] control plane version: v1.23.1

	I1231 11:23:15.715529    6964 kubeadm.go:618] The running cluster does not require reconfiguration: 127.0.0.1

	I1231 11:23:15.715529    6964 kubeadm.go:390] StartCluster complete in 4.5868803s

	I1231 11:23:15.715529    6964 settings.go:142] acquiring lock: {Name:mk2f48f1c2db86c45c5c20d13312e07e9c171d09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:23:15.715529    6964 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 11:23:15.717543    6964 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:23:15.731506    6964 kapi.go:59] client config for pause-20211231111903-1576: &rest.Config{Host:"https://127.0.0.1:56090", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\pause-20211231111903-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\pause-20211231111903-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", CertData:[]uint8(nil), KeyData:[

]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:23:15.757491    6964 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "pause-20211231111903-1576" rescaled to 1

	I1231 11:23:15.757491    6964 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1231 11:23:15.758521    6964 start.go:206] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.23.1 ControlPlane:true Worker:true}

	I1231 11:23:15.758521    6964 addons.go:415] enableAddons start: toEnable=map[], additional=[]

	I1231 11:23:15.758521    6964 addons.go:65] Setting storage-provisioner=true in profile "pause-20211231111903-1576"

	I1231 11:23:15.758521    6964 addons.go:65] Setting default-storageclass=true in profile "pause-20211231111903-1576"

	I1231 11:23:15.758521    6964 config.go:176] Loaded profile config "pause-20211231111903-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.1

	I1231 11:23:15.762511    6964 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "pause-20211231111903-1576"

	I1231 11:23:15.762511    6964 out.go:176] * Verifying Kubernetes components...

	I1231 11:23:15.762511    6964 addons.go:153] Setting addon storage-provisioner=true in "pause-20211231111903-1576"

	W1231 11:23:15.762511    6964 addons.go:165] addon storage-provisioner should already be in state true

	I1231 11:23:15.765495    6964 host.go:66] Checking if "pause-20211231111903-1576" exists ...

	I1231 11:23:15.780519    6964 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1231 11:23:15.787553    6964 cli_runner.go:133] Run: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}

	I1231 11:23:15.787553    6964 cli_runner.go:133] Run: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}

	I1231 11:23:17.351691    6964 cli_runner.go:186] Completed: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}: (1.5641321s)

	I1231 11:23:17.353684    6964 kapi.go:59] client config for pause-20211231111903-1576: &rest.Config{Host:"https://127.0.0.1:56090", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\pause-20211231111903-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\pause-20211231111903-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", CertData:[]uint8(nil), KeyData:[

]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:23:17.360705    6964 cli_runner.go:186] Completed: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}: (1.5731458s)

	I1231 11:23:17.364676    6964 out.go:176]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1231 11:23:17.365697    6964 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1231 11:23:17.365697    6964 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1231 11:23:17.375679    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:17.980465    6964 addons.go:153] Setting addon default-storageclass=true in "pause-20211231111903-1576"

	W1231 11:23:17.980465    6964 addons.go:165] addon default-storageclass should already be in state true

	I1231 11:23:17.980465    6964 host.go:66] Checking if "pause-20211231111903-1576" exists ...

	I1231 11:23:17.996457    6964 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (2.2389564s)

	I1231 11:23:17.996457    6964 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (2.2159283s)

	I1231 11:23:17.996457    6964 start.go:753] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I1231 11:23:18.005446    6964 cli_runner.go:133] Run: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}

	I1231 11:23:18.008617    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:18.280443    7616 ssh_runner.go:235] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/dashboard_v2.3.1 | docker load": (12.2232539s)

	I1231 11:23:18.280443    7616 cache_images.go:315] Transferred and loaded C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\images\docker.io\kubernetesui\dashboard_v2.3.1 from cache

	I1231 11:23:18.280443    7616 cache_images.go:123] Successfully loaded all cached images

	I1231 11:23:18.280443    7616 cache_images.go:92] LoadImages completed in 21.0602489s

	I1231 11:23:18.287447    7616 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1231 11:23:18.434444    7616 cni.go:93] Creating CNI manager for ""

	I1231 11:23:18.434444    7616 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:23:18.435445    7616 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1231 11:23:18.435445    7616 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:172.17.0.2 APIServerPort:8443 KubernetesVersion:v1.18.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:stopped-upgrade-20211231111352-1576 NodeName:stopped-upgrade-20211231111352-1576 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "172.17.0.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:172.17.0.2 CgroupDriver:cgroupfs ClientCAFile

:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I1231 11:23:18.435445    7616 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 172.17.0.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "stopped-upgrade-20211231111352-1576"

	  kubeletExtraArgs:

	    node-ip: 172.17.0.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "172.17.0.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.18.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1231 11:23:18.435445    7616 kubeadm.go:788] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.18.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=stopped-upgrade-20211231111352-1576 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=172.17.0.2

	[Install]

	 config:

	{KubernetesVersion:v1.18.0 ClusterName:stopped-upgrade-20211231111352-1576 Namespace: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1231 11:23:18.445448    7616 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.0

	I1231 11:23:18.472473    7616 binaries.go:44] Found k8s binaries, skipping transfer

	I1231 11:23:18.482443    7616 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1231 11:23:18.508451    7616 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (359 bytes)

	I1231 11:23:18.553454    7616 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1231 11:23:18.601455    7616 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2072 bytes)

	I1231 11:23:18.659447    7616 ssh_runner.go:195] Run: grep 172.17.0.2	control-plane.minikube.internal$ /etc/hosts

	I1231 11:23:18.675519    7616 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "172.17.0.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1231 11:23:18.711460    7616 certs.go:54] Setting up C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576 for IP: 172.17.0.2

	I1231 11:23:18.711460    7616 certs.go:182] skipping minikubeCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key

	I1231 11:23:18.712460    7616 certs.go:182] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key

	I1231 11:23:18.712460    7616 certs.go:298] skipping minikube-user signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\client.key

	I1231 11:23:18.713453    7616 certs.go:302] generating minikube signed cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.key.7b749c5f

	I1231 11:23:18.713453    7616 crypto.go:68] Generating cert C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.crt.7b749c5f with IP's: [172.17.0.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I1231 11:23:19.014457    7616 crypto.go:156] Writing cert to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.crt.7b749c5f ...

	I1231 11:23:19.015443    7616 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.crt.7b749c5f: {Name:mk97434e7038d9c1caf6735fafaca907dac7728a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:23:19.016451    7616 crypto.go:164] Writing key to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.key.7b749c5f ...

	I1231 11:23:19.016451    7616 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.key.7b749c5f: {Name:mk7cf6897cfa3042eb783d255ce83af3588d365b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:23:19.018451    7616 certs.go:320] copying C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.crt.7b749c5f -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.crt

	I1231 11:23:19.035493    7616 certs.go:324] copying C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.key.7b749c5f -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.key

	I1231 11:23:19.037451    7616 certs.go:298] skipping aggregator signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\proxy-client.key

	I1231 11:23:19.039451    7616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576.pem (1338 bytes)

	W1231 11:23:19.040452    7616 certs.go:384] ignoring C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576_empty.pem, impossibly tiny 0 bytes

	I1231 11:23:19.040452    7616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem (1679 bytes)

	I1231 11:23:19.040452    7616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem (1082 bytes)

	I1231 11:23:19.041450    7616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I1231 11:23:19.041450    7616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I1231 11:23:19.042456    7616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem (1708 bytes)

	I1231 11:23:19.046453    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1231 11:23:19.108448    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1231 11:23:19.167474    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1231 11:23:19.228451    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\stopped-upgrade-20211231111352-1576\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I1231 11:23:19.294447    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1231 11:23:19.356456    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1231 11:23:19.422446    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1231 11:23:19.481462    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1231 11:23:19.539456    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem --> /usr/share/ca-certificates/15762.pem (1708 bytes)

	I1231 11:23:19.601482    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1231 11:23:19.676454    7616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576.pem --> /usr/share/ca-certificates/1576.pem (1338 bytes)

	I1231 11:23:19.739494    7616 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I1231 11:23:19.816490    7616 ssh_runner.go:195] Run: openssl version

	I1231 11:23:19.847475    7616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1231 11:23:19.897457    7616 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:23:19.908452    7616 certs.go:431] hashing: -rwxr-xr-x 1 root root 1111 Dec 31 09:49 /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:23:19.918447    7616 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:23:19.949442    7616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1231 11:23:19.993483    7616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1576.pem && ln -fs /usr/share/ca-certificates/1576.pem /etc/ssl/certs/1576.pem"

	I1231 11:23:20.031467    7616 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1576.pem

	I1231 11:23:20.048448    7616 certs.go:431] hashing: -rwxr-xr-x 1 root root 1338 Dec 31 10:02 /usr/share/ca-certificates/1576.pem

	I1231 11:23:20.064471    7616 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1576.pem

	I1231 11:23:20.097451    7616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1576.pem /etc/ssl/certs/51391683.0"

	I1231 11:23:19.012446    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.6367608s)

	I1231 11:23:19.012446    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:23:19.211452    6964 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1231 11:23:19.784451    6964 cli_runner.go:186] Completed: docker container inspect pause-20211231111903-1576 --format={{.State.Status}}: (1.7789972s)

	I1231 11:23:19.784451    6964 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml

	I1231 11:23:19.784451    6964 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1231 11:23:19.793464    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" pause-20211231111903-1576: (1.784839s)

	I1231 11:23:19.793464    6964 node_ready.go:35] waiting up to 6m0s for node "pause-20211231111903-1576" to be "Ready" ...

	I1231 11:23:19.796489    6964 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576

	I1231 11:23:19.807478    6964 node_ready.go:49] node "pause-20211231111903-1576" has status "Ready":"True"

	I1231 11:23:19.807478    6964 node_ready.go:38] duration metric: took 14.0143ms waiting for node "pause-20211231111903-1576" to be "Ready" ...

	I1231 11:23:19.807478    6964 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1231 11:23:19.848461    6964 pod_ready.go:78] waiting up to 6m0s for pod "coredns-64897985d-rv9pb" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:19.886466    6964 pod_ready.go:92] pod "coredns-64897985d-rv9pb" in "kube-system" namespace has status "Ready":"True"

	I1231 11:23:19.886466    6964 pod_ready.go:81] duration metric: took 38.0053ms waiting for pod "coredns-64897985d-rv9pb" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:19.886466    6964 pod_ready.go:78] waiting up to 6m0s for pod "etcd-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:19.973462    6964 pod_ready.go:92] pod "etcd-pause-20211231111903-1576" in "kube-system" namespace has status "Ready":"True"

	I1231 11:23:19.973462    6964 pod_ready.go:81] duration metric: took 86.995ms waiting for pod "etcd-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:19.973462    6964 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:19.991470    6964 pod_ready.go:92] pod "kube-apiserver-pause-20211231111903-1576" in "kube-system" namespace has status "Ready":"True"

	I1231 11:23:19.991470    6964 pod_ready.go:81] duration metric: took 18.0081ms waiting for pod "kube-apiserver-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:19.991470    6964 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:20.052446    6964 pod_ready.go:92] pod "kube-controller-manager-pause-20211231111903-1576" in "kube-system" namespace has status "Ready":"True"

	I1231 11:23:20.052446    6964 pod_ready.go:81] duration metric: took 60.9757ms waiting for pod "kube-controller-manager-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:20.052446    6964 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-zqfxj" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:20.208458    6964 pod_ready.go:92] pod "kube-proxy-zqfxj" in "kube-system" namespace has status "Ready":"True"

	I1231 11:23:20.208458    6964 pod_ready.go:81] duration metric: took 154.9932ms waiting for pod "kube-proxy-zqfxj" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:20.208458    6964 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:20.603472    6964 pod_ready.go:92] pod "kube-scheduler-pause-20211231111903-1576" in "kube-system" namespace has status "Ready":"True"

	I1231 11:23:20.603472    6964 pod_ready.go:81] duration metric: took 394.0264ms waiting for pod "kube-scheduler-pause-20211231111903-1576" in "kube-system" namespace to be "Ready" ...

	I1231 11:23:20.603472    6964 pod_ready.go:38] duration metric: took 795.9907ms for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1231 11:23:20.603472    6964 api_server.go:51] waiting for apiserver process to appear ...

	I1231 11:23:20.618452    6964 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1231 11:23:20.674484    6964 api_server.go:71] duration metric: took 4.9159426s to wait for apiserver process to appear ...

	I1231 11:23:20.674484    6964 api_server.go:87] waiting for apiserver healthz status ...

	I1231 11:23:20.674484    6964 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:56090/healthz ...

	I1231 11:23:20.700486    6964 api_server.go:266] https://127.0.0.1:56090/healthz returned 200:

	ok

	I1231 11:23:20.707461    6964 api_server.go:140] control plane version: v1.23.1

	I1231 11:23:20.707461    6964 api_server.go:130] duration metric: took 32.9765ms to wait for apiserver health ...

	I1231 11:23:20.707461    6964 system_pods.go:43] waiting for kube-system pods to appear ...

	I1231 11:23:20.810456    6964 system_pods.go:59] 7 kube-system pods found

	I1231 11:23:20.810456    6964 system_pods.go:61] "coredns-64897985d-rv9pb" [dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f] Running

	I1231 11:23:20.810456    6964 system_pods.go:61] "etcd-pause-20211231111903-1576" [72622213-821c-4658-9a71-8bd85c7ea55a] Running

	I1231 11:23:20.810456    6964 system_pods.go:61] "kube-apiserver-pause-20211231111903-1576" [0adf54cf-fd98-48c8-8c15-e202982b2f91] Running

	I1231 11:23:20.810456    6964 system_pods.go:61] "kube-controller-manager-pause-20211231111903-1576" [c8852535-307d-4b94-b74d-1fabe79c458d] Running

	I1231 11:23:20.810456    6964 system_pods.go:61] "kube-proxy-zqfxj" [1825a520-13e0-4474-a4e0-67a41d7c78c6] Running

	I1231 11:23:20.810456    6964 system_pods.go:61] "kube-scheduler-pause-20211231111903-1576" [1586a2e1-06da-42a9-8af1-4f8a13373bbc] Running

	I1231 11:23:20.810456    6964 system_pods.go:61] "storage-provisioner" [b045595f-407a-448d-b07b-49071722a847] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I1231 11:23:20.810456    6964 system_pods.go:74] duration metric: took 102.9941ms to wait for pod list to return data ...

	I1231 11:23:20.810456    6964 default_sa.go:34] waiting for default service account to be created ...

	I1231 11:23:21.003664    6964 default_sa.go:45] found service account: "default"

	I1231 11:23:21.003664    6964 default_sa.go:55] duration metric: took 193.2079ms for default service account to be created ...

	I1231 11:23:21.003664    6964 system_pods.go:116] waiting for k8s-apps to be running ...

	I1231 11:23:21.207650    6964 system_pods.go:86] 7 kube-system pods found

	I1231 11:23:21.207650    6964 system_pods.go:89] "coredns-64897985d-rv9pb" [dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f] Running

	I1231 11:23:21.207650    6964 system_pods.go:89] "etcd-pause-20211231111903-1576" [72622213-821c-4658-9a71-8bd85c7ea55a] Running

	I1231 11:23:21.207650    6964 system_pods.go:89] "kube-apiserver-pause-20211231111903-1576" [0adf54cf-fd98-48c8-8c15-e202982b2f91] Running

	I1231 11:23:21.207650    6964 system_pods.go:89] "kube-controller-manager-pause-20211231111903-1576" [c8852535-307d-4b94-b74d-1fabe79c458d] Running

	I1231 11:23:21.207650    6964 system_pods.go:89] "kube-proxy-zqfxj" [1825a520-13e0-4474-a4e0-67a41d7c78c6] Running

	I1231 11:23:21.207650    6964 system_pods.go:89] "kube-scheduler-pause-20211231111903-1576" [1586a2e1-06da-42a9-8af1-4f8a13373bbc] Running

	I1231 11:23:21.207650    6964 system_pods.go:89] "storage-provisioner" [b045595f-407a-448d-b07b-49071722a847] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I1231 11:23:21.207650    6964 system_pods.go:126] duration metric: took 203.9843ms to wait for k8s-apps to be running ...

	I1231 11:23:21.207650    6964 system_svc.go:44] waiting for kubelet service to be running ....

	I1231 11:23:21.217655    6964 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1231 11:23:21.250673    6964 system_svc.go:56] duration metric: took 43.023ms WaitForService to wait for kubelet.

	I1231 11:23:21.250673    6964 kubeadm.go:542] duration metric: took 5.4921284s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I1231 11:23:21.250673    6964 node_conditions.go:102] verifying NodePressure condition ...

	I1231 11:23:21.918047    6964 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211231111903-1576: (2.1205768s)

	I1231 11:23:21.918047    6964 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56091 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\pause-20211231111903-1576\id_rsa Username:docker}

	I1231 11:23:22.065061    6964 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1231 11:23:24.004056    6964 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I1231 11:23:24.004056    6964 node_conditions.go:123] node cpu capacity is 16

	I1231 11:23:24.004056    6964 node_conditions.go:105] duration metric: took 2.7533722s to run NodePressure ...

	I1231 11:23:24.004056    6964 start.go:211] waiting for startup goroutines ...

	I1231 11:23:24.210055    6964 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.1449851s)

	I1231 11:23:24.297064    6964 out.go:176] * Enabled addons: storage-provisioner, default-storageclass

	I1231 11:23:24.297064    6964 addons.go:417] enableAddons completed in 8.5385068s

	I1231 11:23:24.496054    6964 start.go:493] kubectl: 1.18.2, cluster: 1.23.1 (minor skew: 5)

	I1231 11:23:24.603053    6964 out.go:176] 

	W1231 11:23:24.603053    6964 out.go:241] ! C:\ProgramData\chocolatey\bin\kubectl.exe is version 1.18.2, which may have incompatibilites with Kubernetes 1.23.1.

	I1231 11:23:24.698048    6964 out.go:176]   - Want kubectl v1.23.1? Try 'minikube kubectl -- get pods -A'

	I1231 11:23:24.882061    6964 out.go:176] * Done! kubectl is now configured to use "pause-20211231111903-1576" cluster and "default" namespace by default

	I1231 11:23:20.130496    7616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15762.pem && ln -fs /usr/share/ca-certificates/15762.pem /etc/ssl/certs/15762.pem"

	I1231 11:23:20.171461    7616 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15762.pem

	I1231 11:23:20.183484    7616 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Dec 31 10:02 /usr/share/ca-certificates/15762.pem

	I1231 11:23:20.193458    7616 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15762.pem

	I1231 11:23:20.223468    7616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/15762.pem /etc/ssl/certs/3ec20f2e.0"

	I1231 11:23:20.250485    7616 kubeadm.go:388] StartCluster: {Name:stopped-upgrade-20211231111352-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.18.0 ClusterName:stopped-upgrade-20211231111352-1576 Namespace: APIServerName:minikubeCA APIServ

erNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name:m01 IP:172.17.0.2 Port:8443 KubernetesVersion:v1.18.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[] StartHostTimeout:0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString: Mount9PVersion: MountGID: MountIP: MountMSize:0 MountOptions:[] MountPort:0 MountType: MountUID:}

	I1231 11:23:20.259468    7616 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1231 11:23:20.394442    7616 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1231 11:23:20.433451    7616 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1231 11:23:20.459465    7616 kubeadm.go:124] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1231 11:23:20.470456    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:23:22.119054    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.648591s)

	I1231 11:23:22.121046    7616 kubeconfig.go:116] verify returned: extract IP: "stopped-upgrade-20211231111352-1576" does not appear in C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 11:23:22.122066    7616 kubeconfig.go:127] "stopped-upgrade-20211231111352-1576" context is missing from C:\Users\jenkins.minikube7\minikube-integration\kubeconfig - will repair!

	I1231 11:23:22.123063    7616 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:23:22.142056    7616 kapi.go:59] client config for stopped-upgrade-20211231111352-1576: &rest.Config{Host:"https://127.0.0.1:56201", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\stopped-upgrade-20211231111352-1576/client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\stopped-upgrade-20211231111352-1576/client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube/ca.crt", CertD

ata:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:23:22.175054    7616 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1231 11:23:22.204065    7616 kubeadm.go:593] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml	2021-12-31 11:18:24.548623600 +0000

	+++ /var/tmp/minikube/kubeadm.yaml.new	2021-12-31 11:23:18.608623600 +0000

	@@ -23,16 +23,52 @@

	   certSANs: ["127.0.0.1", "localhost", "172.17.0.2"]

	   extraArgs:

	     enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	+controllerManager:

	+  extraArgs:

	+    allocate-node-cidrs: "true"

	+    leader-elect: "false"

	+scheduler:

	+  extraArgs:

	+    leader-elect: "false"

	 certificatesDir: /var/lib/minikube/certs

	 clusterName: mk

	-controlPlaneEndpoint: 172.17.0.2:8443

	+controlPlaneEndpoint: control-plane.minikube.internal:8443

	 dns:

	   type: CoreDNS

	 etcd:

	   local:

	     dataDir: /var/lib/minikube/etcd

	+    extraArgs:

	+      proxy-refresh-interval: "70000"

	 kubernetesVersion: v1.18.0

	 networking:

	   dnsDomain: cluster.local

	   podSubnet: "10.244.0.0/16"

	   serviceSubnet: 10.96.0.0/12

	+---

	+apiVersion: kubelet.config.k8s.io/v1beta1

	+kind: KubeletConfiguration

	+authentication:

	+  x509:

	+    clientCAFile: /var/lib/minikube/certs/ca.crt

	+cgroupDriver: cgroupfs

	+clusterDomain: "cluster.local"

	+# disable disk resource management by default

	+imageGCHighThresholdPercent: 100

	+evictionHard:

	+  nodefs.available: "0%!"(MISSING)

	+  nodefs.inodesFree: "0%!"(MISSING)

	+  imagefs.available: "0%!"(MISSING)

	+failSwapOn: false

	+staticPodPath: /etc/kubernetes/manifests

	+---

	+apiVersion: kubeproxy.config.k8s.io/v1alpha1

	+kind: KubeProxyConfiguration

	+clusterCIDR: "10.244.0.0/16"

	+metricsBindAddress: 0.0.0.0:10249

	+conntrack:

	+  maxPerCore: 0

	+# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	+  tcpEstablishedTimeout: 0s

	+# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	+  tcpCloseWaitTimeout: 0s

	-- /stdout --

	I1231 11:23:22.204065    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"

	I1231 11:23:27.733095    7616 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force": (5.5290069s)

	I1231 11:23:27.743068    7616 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1231 11:23:27.784084    7616 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1231 11:23:27.809077    7616 kubeadm.go:218] ignoring SystemVerification for kubeadm because of docker driver

	I1231 11:23:27.820067    7616 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1231 11:23:27.846124    7616 kubeadm.go:149] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1231 11:23:27.846124    7616 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1231 11:23:44.221953    4432 docker.go:546] Took 31.819325 seconds to copy over tarball

	I1231 11:23:44.229388    4432 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I1231 11:24:01.588393    4432 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (17.3589322s)

	I1231 11:24:01.588393    4432 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I1231 11:24:01.736614    4432 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1231 11:24:01.759506    4432 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (3460 bytes)

	I1231 11:24:01.812002    4432 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1231 11:24:01.991788    4432 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1231 11:24:13.041790    7616 out.go:203]   - Generating certificates and keys ...

	I1231 11:24:13.048804    7616 out.go:203]   - Booting up control plane ...

	I1231 11:24:11.404875    4432 ssh_runner.go:235] Completed: sudo systemctl restart docker: (9.4129429s)

	I1231 11:24:11.417223    4432 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1231 11:24:11.507608    4432 docker.go:581] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.23.2-rc.0

	k8s.gcr.io/kube-controller-manager:v1.23.2-rc.0

	k8s.gcr.io/kube-scheduler:v1.23.2-rc.0

	k8s.gcr.io/kube-proxy:v1.23.2-rc.0

	k8s.gcr.io/etcd:3.5.1-0

	k8s.gcr.io/coredns/coredns:v1.8.6

	k8s.gcr.io/pause:3.6

	kubernetesui/dashboard:v2.3.1

	kubernetesui/metrics-scraper:v1.0.7

	gcr.io/k8s-minikube/storage-provisioner:v5

	<none>:<none>

	<none>:<none>

	<none>:<none>

	<none>:<none>

	<none>:<none>

	k8s.gcr.io/coredns:1.6.2

	<none>:<none>

	-- /stdout --

	I1231 11:24:11.507608    4432 cache_images.go:84] Images are preloaded, skipping loading

	I1231 11:24:11.512604    4432 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1231 11:24:11.809780    4432 cni.go:93] Creating CNI manager for ""

	I1231 11:24:11.809780    4432 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:24:11.809780    4432 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1231 11:24:11.809780    4432 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.58.2 APIServerPort:8443 KubernetesVersion:v1.23.2-rc.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kubernetes-upgrade-20211231111918-1576 NodeName:kubernetes-upgrade-20211231111918-1576 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.58.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.58.2 CgroupDriver:cgro

upfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I1231 11:24:11.809780    4432 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.58.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "kubernetes-upgrade-20211231111918-1576"

	  kubeletExtraArgs:

	    node-ip: 192.168.58.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.58.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.23.2-rc.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1231 11:24:11.809780    4432 kubeadm.go:788] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.23.2-rc.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --global-housekeeping-interval=60m --hostname-override=kubernetes-upgrade-20211231111918-1576 --housekeeping-interval=5m --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.58.2

	[Install]

	 config:

	{KubernetesVersion:v1.23.2-rc.0 ClusterName:kubernetes-upgrade-20211231111918-1576 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1231 11:24:11.818781    4432 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.23.2-rc.0

	I1231 11:24:11.843783    4432 binaries.go:44] Found k8s binaries, skipping transfer

	I1231 11:24:11.854776    4432 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1231 11:24:11.883778    4432 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (431 bytes)

	I1231 11:24:11.922790    4432 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)

	I1231 11:24:11.969805    4432 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2086 bytes)

	I1231 11:24:12.020780    4432 ssh_runner.go:195] Run: grep 192.168.58.2	control-plane.minikube.internal$ /etc/hosts

	I1231 11:24:12.032806    4432 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.58.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1231 11:24:12.075826    4432 certs.go:54] Setting up C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576 for IP: 192.168.58.2

	I1231 11:24:12.076777    4432 certs.go:182] skipping minikubeCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key

	I1231 11:24:12.076777    4432 certs.go:182] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key

	I1231 11:24:12.077789    4432 certs.go:298] skipping minikube-user signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\client.key

	I1231 11:24:12.077789    4432 certs.go:298] skipping minikube signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\apiserver.key.cee25041

	I1231 11:24:12.077789    4432 certs.go:298] skipping aggregator signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\proxy-client.key

	I1231 11:24:12.079784    4432 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576.pem (1338 bytes)

	W1231 11:24:12.079784    4432 certs.go:384] ignoring C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576_empty.pem, impossibly tiny 0 bytes

	I1231 11:24:12.079784    4432 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem (1679 bytes)

	I1231 11:24:12.079784    4432 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem (1082 bytes)

	I1231 11:24:12.080783    4432 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I1231 11:24:12.080783    4432 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I1231 11:24:12.080783    4432 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem (1708 bytes)

	I1231 11:24:12.083805    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1231 11:24:12.137990    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1231 11:24:12.210073    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1231 11:24:12.282416    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20211231111918-1576\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1231 11:24:12.339324    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1231 11:24:12.398470    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1231 11:24:12.464231    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1231 11:24:12.513997    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1231 11:24:12.576745    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1231 11:24:12.630282    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\1576.pem --> /usr/share/ca-certificates/1576.pem (1338 bytes)

	I1231 11:24:12.689233    4432 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\15762.pem --> /usr/share/ca-certificates/15762.pem (1708 bytes)

	I1231 11:24:12.749451    4432 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1231 11:24:12.799669    4432 ssh_runner.go:195] Run: openssl version

	I1231 11:24:12.824713    4432 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1231 11:24:12.867822    4432 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:24:12.881692    4432 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Dec 31 09:49 /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:24:12.888680    4432 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1231 11:24:12.909685    4432 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1231 11:24:12.956838    4432 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1576.pem && ln -fs /usr/share/ca-certificates/1576.pem /etc/ssl/certs/1576.pem"

	I1231 11:24:12.991792    4432 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1576.pem

	I1231 11:24:13.001795    4432 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Dec 31 10:02 /usr/share/ca-certificates/1576.pem

	I1231 11:24:13.009802    4432 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1576.pem

	I1231 11:24:13.044787    4432 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1576.pem /etc/ssl/certs/51391683.0"

	I1231 11:24:13.086793    4432 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15762.pem && ln -fs /usr/share/ca-certificates/15762.pem /etc/ssl/certs/15762.pem"

	I1231 11:24:13.128042    4432 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15762.pem

	I1231 11:24:13.145794    4432 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Dec 31 10:02 /usr/share/ca-certificates/15762.pem

	I1231 11:24:13.163809    4432 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15762.pem

	I1231 11:24:13.183754    4432 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/15762.pem /etc/ssl/certs/3ec20f2e.0"

	I1231 11:24:13.205767    4432 kubeadm.go:388] StartCluster: {Name:kubernetes-upgrade-20211231111918-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.2-rc.0 ClusterName:kubernetes-upgrade-20211231111918-1576 Namespace:default APIServer

Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.23.2-rc.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions

:[] MountPort:0 MountType:9p MountUID:docker}

	I1231 11:24:13.212768    4432 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1231 11:24:13.311179    4432 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1231 11:24:13.354529    4432 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1231 11:24:13.380505    4432 kubeadm.go:124] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1231 11:24:13.388505    4432 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576

	I1231 11:24:13.060822    7616 out.go:203]   - Configuring RBAC rules ...

	I1231 11:24:13.066809    7616 cni.go:93] Creating CNI manager for ""

	I1231 11:24:13.067804    7616 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:24:13.067804    7616 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1231 11:24:13.080819    7616 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.0/kubectl label nodes minikube.k8s.io/version=v1.24.0 minikube.k8s.io/commit=a81813405fc4902e1caabd8d69223ec230d201fb minikube.k8s.io/name=stopped-upgrade-20211231111352-1576 minikube.k8s.io/updated_at=2021_12_31T11_24_13_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I1231 11:24:13.080819    7616 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1231 11:24:13.160792    7616 ops.go:34] apiserver oom_adj: -16

	I1231 11:24:14.541353    7616 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.18.0/kubectl label nodes minikube.k8s.io/version=v1.24.0 minikube.k8s.io/commit=a81813405fc4902e1caabd8d69223ec230d201fb minikube.k8s.io/name=stopped-upgrade-20211231111352-1576 minikube.k8s.io/updated_at=2021_12_31T11_24_13_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig: (1.4605281s)

	I1231 11:24:14.541681    7616 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.18.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig: (1.4605281s)

	I1231 11:24:14.541681    7616 kubeadm.go:864] duration metric: took 1.4738703s to wait for elevateKubeSystemPrivileges.

	I1231 11:24:14.541829    7616 kubeadm.go:390] StartCluster complete in 54.2911154s

	I1231 11:24:14.541829    7616 settings.go:142] acquiring lock: {Name:mk2f48f1c2db86c45c5c20d13312e07e9c171d09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:24:14.542128    7616 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 11:24:14.544939    7616 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:24:14.566126    7616 kapi.go:59] client config for stopped-upgrade-20211231111352-1576: &rest.Config{Host:"https://127.0.0.1:56201", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\stopped-upgrade-20211231111352-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\stopped-upgrade-20211231111352-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", Ce

rtData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:24:15.346977    7616 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "stopped-upgrade-20211231111352-1576" rescaled to 1

	I1231 11:24:15.346977    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1231 11:24:15.348032    7616 start.go:206] Will wait 6m0s for node &{Name:m01 IP:172.17.0.2 Port:8443 KubernetesVersion:v1.18.0 ControlPlane:true Worker:true}

	I1231 11:24:15.348032    7616 addons.go:415] enableAddons start: toEnable=map[default-storageclass:true storage-provisioner:true], additional=[]

	I1231 11:24:15.352034    7616 out.go:176] * Verifying Kubernetes components...

	I1231 11:24:15.348997    7616 addons.go:65] Setting storage-provisioner=true in profile "stopped-upgrade-20211231111352-1576"

	I1231 11:24:15.352034    7616 addons.go:153] Setting addon storage-provisioner=true in "stopped-upgrade-20211231111352-1576"

	I1231 11:24:15.348997    7616 addons.go:65] Setting default-storageclass=true in profile "stopped-upgrade-20211231111352-1576"

	I1231 11:24:15.348997    7616 config.go:176] Loaded profile config "stopped-upgrade-20211231111352-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	W1231 11:24:15.352991    7616 addons.go:165] addon storage-provisioner should already be in state true

	I1231 11:24:15.352991    7616 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "stopped-upgrade-20211231111352-1576"

	I1231 11:24:15.352991    7616 host.go:66] Checking if "stopped-upgrade-20211231111352-1576" exists ...

	I1231 11:24:15.368992    7616 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1231 11:24:15.376983    7616 cli_runner.go:133] Run: docker container inspect stopped-upgrade-20211231111352-1576 --format={{.State.Status}}

	I1231 11:24:15.380984    7616 cli_runner.go:133] Run: docker container inspect stopped-upgrade-20211231111352-1576 --format={{.State.Status}}

	I1231 11:24:16.447134    7616 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (1.1001519s)

	I1231 11:24:16.447134    7616 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (1.0771511s)

	I1231 11:24:16.447134    7616 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.2 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1231 11:24:16.467123    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:24:17.087355    7616 cli_runner.go:186] Completed: docker container inspect stopped-upgrade-20211231111352-1576 --format={{.State.Status}}: (1.7103642s)

	I1231 11:24:17.090364    7616 kapi.go:59] client config for stopped-upgrade-20211231111352-1576: &rest.Config{Host:"https://127.0.0.1:56201", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\stopped-upgrade-20211231111352-1576\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\stopped-upgrade-20211231111352-1576\\client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\ca.crt", Ce

rtData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:24:17.123334    7616 cli_runner.go:186] Completed: docker container inspect stopped-upgrade-20211231111352-1576 --format={{.State.Status}}: (1.7423432s)

	I1231 11:24:14.921090    4432 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" kubernetes-upgrade-20211231111918-1576: (1.5325362s)

	I1231 11:24:14.923764    4432 kubeconfig.go:116] verify returned: extract IP: "kubernetes-upgrade-20211231111918-1576" does not appear in C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 11:24:14.924602    4432 kubeconfig.go:127] "kubernetes-upgrade-20211231111918-1576" context is missing from C:\Users\jenkins.minikube7\minikube-integration\kubeconfig - will repair!

	I1231 11:24:14.926082    4432 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1231 11:24:14.936418    4432 kapi.go:59] client config for kubernetes-upgrade-20211231111918-1576: &rest.Config{Host:"https://127.0.0.1:56221", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\kubernetes-upgrade-20211231111918-1576/client.crt", KeyFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube\\profiles\\kubernetes-upgrade-20211231111918-1576/client.key", CAFile:"C:\\Users\\jenkins.minikube7\\minikube-integration\\.minikube/ca.cr

t", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x155f780), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1231 11:24:14.971400    4432 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1231 11:24:14.994415    4432 kubeadm.go:593] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml	2021-12-31 11:21:22.698623600 +0000

	+++ /var/tmp/minikube/kubeadm.yaml.new	2021-12-31 11:24:11.978623600 +0000

	@@ -1,4 +1,4 @@

	-apiVersion: kubeadm.k8s.io/v1beta1

	+apiVersion: kubeadm.k8s.io/v1beta2

	 kind: InitConfiguration

	 localAPIEndpoint:

	   advertiseAddress: 192.168.58.2

	@@ -17,7 +17,7 @@

	     node-ip: 192.168.58.2

	   taints: []

	 ---

	-apiVersion: kubeadm.k8s.io/v1beta1

	+apiVersion: kubeadm.k8s.io/v1beta2

	 kind: ClusterConfiguration

	 apiServer:

	   certSANs: ["127.0.0.1", "localhost", "192.168.58.2"]

	@@ -31,7 +31,7 @@

	   extraArgs:

	     leader-elect: "false"

	 certificatesDir: /var/lib/minikube/certs

	-clusterName: kubernetes-upgrade-20211231111918-1576

	+clusterName: mk

	 controlPlaneEndpoint: control-plane.minikube.internal:8443

	 dns:

	   type: CoreDNS

	@@ -39,8 +39,8 @@

	   local:

	     dataDir: /var/lib/minikube/etcd

	     extraArgs:

	-      listen-metrics-urls: http://127.0.0.1:2381,http://192.168.58.2:2381

	-kubernetesVersion: v1.16.0

	+      proxy-refresh-interval: "70000"

	+kubernetesVersion: v1.23.2-rc.0

	 networking:

	   dnsDomain: cluster.local

	   podSubnet: "10.244.0.0/16"

	-- /stdout --

	I1231 11:24:14.994415    4432 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.2-rc.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"

	I1231 11:24:18.865964    4432 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.2-rc.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force": (3.8715328s)

	I1231 11:24:18.883958    4432 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1231 11:24:18.930954    4432 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1231 11:24:18.958998    4432 kubeadm.go:218] ignoring SystemVerification for kubeadm because of docker driver

	I1231 11:24:18.968943    4432 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1231 11:24:18.992952    4432 kubeadm.go:149] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1231 11:24:18.992952    4432 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.2-rc.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1231 11:24:17.128335    7616 out.go:176]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1231 11:24:17.128335    7616 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1231 11:24:17.128335    7616 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1231 11:24:17.136394    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:24:17.152759    7616 addons.go:153] Setting addon default-storageclass=true in "stopped-upgrade-20211231111352-1576"

	W1231 11:24:17.152759    7616 addons.go:165] addon default-storageclass should already be in state true

	I1231 11:24:17.152759    7616 host.go:66] Checking if "stopped-upgrade-20211231111352-1576" exists ...

	I1231 11:24:17.177464    7616 cli_runner.go:133] Run: docker container inspect stopped-upgrade-20211231111352-1576 --format={{.State.Status}}

	I1231 11:24:18.060040    7616 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.2 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.18.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.6129001s)

	I1231 11:24:18.060040    7616 start.go:773] {"host.minikube.internal": 192.168.65.2} host record injected into CoreDNS

	I1231 11:24:18.268991    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.8018598s)

	I1231 11:24:18.269238    7616 kubeadm.go:479] skip waiting for components based on config.

	I1231 11:24:18.269238    7616 node_conditions.go:102] verifying NodePressure condition ...

	I1231 11:24:18.296961    7616 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I1231 11:24:18.296961    7616 node_conditions.go:123] node cpu capacity is 16

	I1231 11:24:18.296961    7616 node_conditions.go:105] duration metric: took 27.573ms to run NodePressure ...

	I1231 11:24:18.296961    7616 start.go:211] waiting for startup goroutines ...

	I1231 11:24:18.915970    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.779568s)

	I1231 11:24:18.915970    7616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56202 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\stopped-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:24:18.922950    7616 cli_runner.go:186] Completed: docker container inspect stopped-upgrade-20211231111352-1576 --format={{.State.Status}}: (1.7454782s)

	I1231 11:24:18.922950    7616 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml

	I1231 11:24:18.922950    7616 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1231 11:24:18.931950    7616 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576

	I1231 11:24:19.090669    7616 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1231 11:24:20.529028    7616 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211231111352-1576: (1.5969772s)

	I1231 11:24:20.529718    7616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:56202 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\stopped-upgrade-20211231111352-1576\id_rsa Username:docker}

	I1231 11:24:20.729780    7616 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1231 11:24:21.121703    7616 out.go:176] * Enabled addons: storage-provisioner, default-storageclass

	I1231 11:24:21.121830    7616 addons.go:417] enableAddons completed in 5.7737737s

	I1231 11:24:21.331674    7616 start.go:493] kubectl: 1.18.2, cluster: 1.18.0 (minor skew: 0)

	I1231 11:24:21.335654    7616 out.go:176] * Done! kubectl is now configured to use "stopped-upgrade-20211231111352-1576" cluster and "" namespace by default

	* 

	* ==> Docker <==

	* -- Logs begin at Fri 2021-12-31 11:20:35 UTC, end at Fri 2021-12-31 11:25:08 UTC. --

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.702861200Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.702894300Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.714203600Z" level=info msg="parsed scheme: \"unix\"" module=grpc

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.714406600Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.714536100Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.714654400Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.744941600Z" level=info msg="[graphdriver] using prior storage driver: overlay2"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.770369300Z" level=warning msg="Your kernel does not support cgroup blkio weight"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.770484100Z" level=warning msg="Your kernel does not support cgroup blkio weight_device"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.770502200Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_bps_device"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.770509400Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_bps_device"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.770517400Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_iops_device"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.770523800Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_iops_device"

	Dec 31 11:21:00 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:00.771092500Z" level=info msg="Loading containers: start."

	Dec 31 11:21:03 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:03.343501800Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"

	Dec 31 11:21:04 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:04.711136700Z" level=info msg="Loading containers: done."

	Dec 31 11:21:04 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:04.771651500Z" level=info msg="Docker daemon" commit=459d0df graphdriver(s)=overlay2 version=20.10.12

	Dec 31 11:21:04 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:04.772097300Z" level=info msg="Daemon has completed initialization"

	Dec 31 11:21:04 pause-20211231111903-1576 systemd[1]: Started Docker Application Container Engine.

	Dec 31 11:21:04 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:04.839079400Z" level=info msg="API listen on [::]:2376"

	Dec 31 11:21:04 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:21:04.849476400Z" level=info msg="API listen on /var/run/docker.sock"

	Dec 31 11:23:50 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:23:50.532092600Z" level=info msg="ignoring event" container=f058545bad9de7df5c68cd5cf5aba8846942577907b1f229f21e7676a8736b2e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Dec 31 11:23:59 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:23:59.064393700Z" level=error msg="Handler for POST /v1.41/containers/0843676a5aa7/pause returned error: Cannot pause container 0843676a5aa7b1cbebd6a16a57ca6a1278c3da65fd3a4b46465cc4df734482ac: OCI runtime pause failed: unable to freeze: unknown"

	Dec 31 11:24:07 pause-20211231111903-1576 dockerd[473]: time="2021-12-31T11:24:07.028712900Z" level=error msg="Handler for GET /v1.41/containers/f058545bad9de7df5c68cd5cf5aba8846942577907b1f229f21e7676a8736b2e/json returned error: write unix /var/run/docker.sock->@: write: broken pipe"

	Dec 31 11:24:07 pause-20211231111903-1576 dockerd[473]: http: superfluous response.WriteHeader call from github.com/docker/docker/api/server/httputils.WriteJSON (httputils_write_json.go:11)

	* 

	* ==> container status <==

	* time="2021-12-31T11:25:10Z" level=fatal msg="connect: connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"

	CONTAINER ID   IMAGE                  COMMAND                  CREATED              STATUS                            PORTS     NAMES

	f058545bad9d   6e38f40d628d           "/storage-provisioner"   About a minute ago   Exited (255) About a minute ago             k8s_storage-provisioner_storage-provisioner_kube-system_b045595f-407a-448d-b07b-49071722a847_0

	170e6b6065b2   k8s.gcr.io/pause:3.6   "/pause"                 About a minute ago   Up About a minute (Paused)                  k8s_POD_storage-provisioner_kube-system_b045595f-407a-448d-b07b-49071722a847_0

	74a4e3d88a70   a4ca41631cc7           "/coredns -conf /etc…"   3 minutes ago        Up 3 minutes (Paused)                       k8s_coredns_coredns-64897985d-rv9pb_kube-system_dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f_0

	8fa6dc58558e   b46c42588d51           "/usr/local/bin/kube…"   3 minutes ago        Up 3 minutes (Paused)                       k8s_kube-proxy_kube-proxy-zqfxj_kube-system_1825a520-13e0-4474-a4e0-67a41d7c78c6_0

	df30f3b8d297   k8s.gcr.io/pause:3.6   "/pause"                 3 minutes ago        Up 3 minutes (Paused)                       k8s_POD_kube-proxy-zqfxj_kube-system_1825a520-13e0-4474-a4e0-67a41d7c78c6_0

	d320cc67dbfe   k8s.gcr.io/pause:3.6   "/pause"                 3 minutes ago        Up 3 minutes (Paused)                       k8s_POD_coredns-64897985d-rv9pb_kube-system_dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f_0

	0312af21019e   b6d7abedde39           "kube-apiserver --ad…"   3 minutes ago        Up 3 minutes (Paused)                       k8s_kube-apiserver_kube-apiserver-pause-20211231111903-1576_kube-system_61a858f6d0a505095df4f4e361b4fe99_0

	59516730c193   71d575efe628           "kube-scheduler --au…"   3 minutes ago        Up 3 minutes (Paused)                       k8s_kube-scheduler_kube-scheduler-pause-20211231111903-1576_kube-system_1b44de50cea5ab5eb4c4156cdbe670e2_0

	0cc844e63a7c   f51846a4fd28           "kube-controller-man…"   3 minutes ago        Up 3 minutes (Paused)                       k8s_kube-controller-manager_kube-controller-manager-pause-20211231111903-1576_kube-system_10435ba0d5da11c3134135f4e5f33b73_0

	0843676a5aa7   25f8c7f3da61           "etcd --advertise-cl…"   3 minutes ago        Up 3 minutes                                k8s_etcd_etcd-pause-20211231111903-1576_kube-system_ab6596944a7a3af683b87c004de894f8_0

	101beefb89f1   k8s.gcr.io/pause:3.6   "/pause"                 3 minutes ago        Up 3 minutes (Paused)                       k8s_POD_kube-scheduler-pause-20211231111903-1576_kube-system_1b44de50cea5ab5eb4c4156cdbe670e2_0

	2b8f428d720b   k8s.gcr.io/pause:3.6   "/pause"                 3 minutes ago        Up 3 minutes (Paused)                       k8s_POD_kube-controller-manager-pause-20211231111903-1576_kube-system_10435ba0d5da11c3134135f4e5f33b73_0

	50cfe963fa30   k8s.gcr.io/pause:3.6   "/pause"                 3 minutes ago        Up 3 minutes (Paused)                       k8s_POD_kube-apiserver-pause-20211231111903-1576_kube-system_61a858f6d0a505095df4f4e361b4fe99_0

	62f3e2013ffe   k8s.gcr.io/pause:3.6   "/pause"                 3 minutes ago        Up 3 minutes (Paused)                       k8s_POD_etcd-pause-20211231111903-1576_kube-system_ab6596944a7a3af683b87c004de894f8_0

	* 

	* ==> coredns [74a4e3d88a70] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API

	.:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.6

	linux/amd64, go1.17.1, 13a9191

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] Reloading

	[INFO] plugin/health: Going into lameduck mode for 5s

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	[INFO] Reloading complete

	* 

	* ==> describe nodes <==

	* 

	* ==> dmesg <==

	* [Dec31 11:08] WSL2: Performing memory compaction.

	[Dec31 11:09] WSL2: Performing memory compaction.

	[Dec31 11:10] WSL2: Performing memory compaction.

	[Dec31 11:11] WSL2: Performing memory compaction.

	[Dec31 11:12] WSL2: Performing memory compaction.

	[Dec31 11:13] WSL2: Performing memory compaction.

	[Dec31 11:14] WSL2: Performing memory compaction.

	[Dec31 11:15] WSL2: Performing memory compaction.

	[ +22.250121] process 'docker/tmp/qemu-check699144709/check' started with executable stack

	[Dec31 11:16] WSL2: Performing memory compaction.

	[Dec31 11:18] WSL2: Performing memory compaction.

	[Dec31 11:20] WSL2: Performing memory compaction.

	[Dec31 11:21] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000006] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.003869] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000005] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.001553] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000003] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000661] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000005] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.054411] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000006] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[Dec31 11:24] WSL2: Performing memory compaction.

	[ +33.237444] hrtimer: interrupt took 426600 ns

	[Dec31 11:25] WSL2: Performing memory compaction.

	* 

	* ==> etcd [0843676a5aa7] <==

	* {"level":"warn","ts":"2021-12-31T11:23:58.263Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:57.723Z","time spent":"540.8338ms","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""}

	{"level":"warn","ts":"2021-12-31T11:23:58.264Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:57.723Z","time spent":"540.3328ms","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-12-31T11:23:58.264Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:57.723Z","time spent":"540.3343ms","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-12-31T11:23:58.264Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:57.724Z","time spent":"540.1756ms","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-12-31T11:23:58.275Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.5579609s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/coredns-64897985d-rv9pb\" ","response":"","error":"context canceled"}

	{"level":"info","ts":"2021-12-31T11:23:58.275Z","caller":"traceutil/trace.go:171","msg":"trace[1873031848] range","detail":"{range_begin:/registry/pods/kube-system/coredns-64897985d-rv9pb; range_end:; }","duration":"2.5585022s","start":"2021-12-31T11:23:55.717Z","end":"2021-12-31T11:23:58.275Z","steps":["trace[1873031848] 'agreement among raft nodes before linearized reading'  (duration: 2.1531394s)","trace[1873031848] 'range keys from in-memory index tree'  (duration: 405.108ms)"],"step_count":2}

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.5387194s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/pause-20211231111903-1576\" ","response":"","error":"context canceled"}

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.5442229s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-apiserver-pause-20211231111903-1576\" ","response":"","error":"context canceled"}

	{"level":"info","ts":"2021-12-31T11:23:58.276Z","caller":"traceutil/trace.go:171","msg":"trace[1885684326] range","detail":"{range_begin:/registry/pods/kube-system/kube-apiserver-pause-20211231111903-1576; range_end:; }","duration":"2.5443138s","start":"2021-12-31T11:23:55.731Z","end":"2021-12-31T11:23:58.276Z","steps":["trace[1885684326] 'agreement among raft nodes before linearized reading'  (duration: 2.1386993s)","trace[1885684326] 'range keys from in-memory index tree'  (duration: 405.5064ms)"],"step_count":2}

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:55.731Z","time spent":"2.5443715s","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Range","request count":0,"request size":69,"response count":0,"response size":0,"request content":"key:\"/registry/pods/kube-system/kube-apiserver-pause-20211231111903-1576\" "}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"405.318ms","expected-duration":"100ms","prefix":"","request":"header:<ID:8128010035642347343 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/pods/kube-system/etcd-pause-20211231111903-1576\" mod_revision:0 > success:<request_put:<key:\"/registry/pods/kube-system/etcd-pause-20211231111903-1576\" value_size:3946 >> failure:<>>","response":"size:5"}

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:55.717Z","time spent":"2.5585783s","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":0,"response size":0,"request content":"key:\"/registry/pods/kube-system/coredns-64897985d-rv9pb\" "}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"info","ts":"2021-12-31T11:23:58.276Z","caller":"traceutil/trace.go:171","msg":"trace[315008577] range","detail":"{range_begin:/registry/minions/pause-20211231111903-1576; range_end:; }","duration":"2.5388448s","start":"2021-12-31T11:23:55.737Z","end":"2021-12-31T11:23:58.276Z","steps":["trace[315008577] 'agreement among raft nodes before linearized reading'  (duration: 2.1333195s)","trace[315008577] 'range keys from in-memory index tree'  (duration: 405.3904ms)"],"step_count":2}

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:55.737Z","time spent":"2.5391542s","remote":"127.0.0.1:37928","response type":"/etcdserverpb.KV/Range","request count":0,"request size":45,"response count":0,"response size":0,"request content":"key:\"/registry/minions/pause-20211231111903-1576\" "}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.5581128s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/storage-provisioner\" ","response":"","error":"context canceled"}

	{"level":"info","ts":"2021-12-31T11:23:58.276Z","caller":"traceutil/trace.go:171","msg":"trace[2119726512] range","detail":"{range_begin:/registry/pods/kube-system/storage-provisioner; range_end:; }","duration":"2.5587074s","start":"2021-12-31T11:23:55.717Z","end":"2021-12-31T11:23:58.276Z","steps":["trace[2119726512] 'agreement among raft nodes before linearized reading'  (duration: 2.1526472s)","trace[2119726512] 'range keys from in-memory index tree'  (duration: 405.4532ms)"],"step_count":2}

	{"level":"warn","ts":"2021-12-31T11:23:58.276Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-31T11:23:55.717Z","time spent":"2.5587655s","remote":"127.0.0.1:37932","response type":"/etcdserverpb.KV/Range","request count":0,"request size":48,"response count":0,"response size":0,"request content":"key:\"/registry/pods/kube-system/storage-provisioner\" "}

	WARNING: 2021/12/31 11:23:58 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-12-31T11:24:07.013Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.2903296s","expected-duration":"1s"}

	* 

	* ==> kernel <==

	*  11:25:21 up  1:43,  0 users,  load average: 6.26, 5.73, 3.64

	Linux pause-20211231111903-1576 5.10.16.3-microsoft-standard-WSL2 #1 SMP Fri Apr 2 22:23:49 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* 

	* ==> kube-apiserver [0312af21019e] <==

	* E1231 11:23:58.294148       1 timeout.go:137] post-timeout activity - time-elapsed: 31.4657ms, POST "/api/v1/namespaces/kube-system/serviceaccounts/storage-provisioner/token" result: <nil>

	E1231 11:23:58.295180       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E1231 11:23:58.296480       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E1231 11:23:58.297959       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	I1231 11:23:58.299328       1 trace.go:205] Trace[719232061]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:Go-http-client/2.0,audit-id:e7c9b0d6-026b-48f1-89a1-708570631734,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-Dec-2021 11:23:52.919) (total time: 5379ms):

	Trace[719232061]: [5.3795541s] [5.3795541s] END

	E1231 11:23:58.299630       1 timeout.go:137] post-timeout activity - time-elapsed: 37.5051ms, POST "/api/v1/namespaces/kube-system/pods" result: <nil>

	E1231 11:23:58.300710       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	I1231 11:23:58.303363       1 trace.go:205] Trace[43791266]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:Go-http-client/2.0,audit-id:519e899d-3e8c-4da2-bdb2-429135cc6087,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-Dec-2021 11:23:52.919) (total time: 5383ms):

	Trace[43791266]: [5.383774s] [5.383774s] END

	E1231 11:23:58.303777       1 timeout.go:137] post-timeout activity - time-elapsed: 41.1881ms, POST "/api/v1/namespaces/kube-system/pods" result: <nil>

	I1231 11:23:58.306018       1 trace.go:205] Trace[1404886063]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:Go-http-client/2.0,audit-id:a1e5f97d-dd66-4df0-a31b-5bfd15dfabfa,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-Dec-2021 11:23:52.918) (total time: 5387ms):

	Trace[1404886063]: [5.3870804s] [5.3870804s] END

	E1231 11:23:58.306349       1 timeout.go:137] post-timeout activity - time-elapsed: 43.5371ms, POST "/api/v1/namespaces/kube-system/pods" result: <nil>

	E1231 11:23:58.307412       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	I1231 11:23:58.309007       1 trace.go:205] Trace[90276809]: "Create" url:/api/v1/namespaces/kube-system/serviceaccounts/coredns/token,user-agent:Go-http-client/2.0,audit-id:4ef675c9-4d20-48b9-af0a-1cce4571c748,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-Dec-2021 11:23:53.545) (total time: 4763ms):

	Trace[90276809]: [4.763649s] [4.763649s] END

	E1231 11:23:58.309299       1 timeout.go:137] post-timeout activity - time-elapsed: 46.6689ms, POST "/api/v1/namespaces/kube-system/serviceaccounts/coredns/token" result: <nil>

	E1231 11:23:58.311634       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	I1231 11:23:58.316141       1 trace.go:205] Trace[1743682991]: "Get" url:/api/v1/nodes/pause-20211231111903-1576,user-agent:Go-http-client/2.0,audit-id:a9caef0d-1c8d-4c4a-8893-7d912f70ee8d,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-Dec-2021 11:23:55.736) (total time: 2579ms):

	Trace[1743682991]: [2.579723s] [2.579723s] END

	I1231 11:23:58.318992       1 trace.go:205] Trace[1139424570]: "Get" url:/api/v1/namespaces/kube-system/pods/kube-apiserver-pause-20211231111903-1576,user-agent:Go-http-client/2.0,audit-id:cf6a805b-015d-4b9e-b0a1-e3e04a0924a8,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-Dec-2021 11:23:55.730) (total time: 2588ms):

	Trace[1139424570]: [2.5880837s] [2.5880837s] END

	E1231 11:23:58.319251       1 timeout.go:137] post-timeout activity - time-elapsed: 56.2576ms, GET "/api/v1/namespaces/kube-system/pods/kube-apiserver-pause-20211231111903-1576" result: <nil>

	E1231 11:23:58.324741       1 timeout.go:137] post-timeout activity - time-elapsed: 61.7735ms, GET "/api/v1/nodes/pause-20211231111903-1576" result: <nil>

	* 

	* ==> kube-controller-manager [0cc844e63a7c] <==

	* W1231 11:22:00.315755       1 node_lifecycle_controller.go:1012] Missing timestamp for Node pause-20211231111903-1576. Assuming now as a timestamp.

	I1231 11:22:00.315850       1 node_lifecycle_controller.go:1163] Controller detected that all Nodes are not-Ready. Entering master disruption mode.

	I1231 11:22:00.319936       1 shared_informer.go:247] Caches are synced for expand 

	I1231 11:22:00.322866       1 shared_informer.go:247] Caches are synced for HPA 

	I1231 11:22:00.323621       1 shared_informer.go:247] Caches are synced for ReplicationController 

	I1231 11:22:00.323975       1 shared_informer.go:247] Caches are synced for job 

	I1231 11:22:00.331200       1 range_allocator.go:374] Set node pause-20211231111903-1576 PodCIDR to [10.244.0.0/24]

	I1231 11:22:00.412677       1 shared_informer.go:240] Waiting for caches to sync for garbage collector

	I1231 11:22:00.512103       1 shared_informer.go:247] Caches are synced for stateful set 

	I1231 11:22:00.512119       1 shared_informer.go:247] Caches are synced for daemon sets 

	I1231 11:22:00.512510       1 shared_informer.go:247] Caches are synced for resource quota 

	I1231 11:22:00.512613       1 shared_informer.go:247] Caches are synced for resource quota 

	I1231 11:22:00.512627       1 shared_informer.go:247] Caches are synced for disruption 

	I1231 11:22:00.512638       1 disruption.go:371] Sending events to api server.

	I1231 11:22:00.512737       1 shared_informer.go:247] Caches are synced for deployment 

	I1231 11:22:00.728021       1 event.go:294] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-64897985d to 2"

	I1231 11:22:01.011579       1 shared_informer.go:247] Caches are synced for garbage collector 

	I1231 11:22:01.011707       1 garbagecollector.go:155] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I1231 11:22:01.013055       1 shared_informer.go:247] Caches are synced for garbage collector 

	I1231 11:22:01.026651       1 event.go:294] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-zqfxj"

	I1231 11:22:01.212406       1 event.go:294] "Event occurred" object="kube-system/coredns-64897985d" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-64897985d-s84z4"

	I1231 11:22:01.312858       1 event.go:294] "Event occurred" object="kube-system/coredns-64897985d" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-64897985d-rv9pb"

	I1231 11:22:01.433025       1 event.go:294] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-64897985d to 1"

	I1231 11:22:01.614430       1 event.go:294] "Event occurred" object="kube-system/coredns-64897985d" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-64897985d-s84z4"

	I1231 11:22:05.317090       1 node_lifecycle_controller.go:1190] Controller detected that some Nodes are Ready. Exiting master disruption mode.

	* 

	* ==> kube-proxy [8fa6dc58558e] <==

	* E1231 11:22:06.322692       1 proxier.go:647] "Failed to read builtin modules file, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" err="open /lib/modules/5.10.16.3-microsoft-standard-WSL2/modules.builtin: no such file or directory" filePath="/lib/modules/5.10.16.3-microsoft-standard-WSL2/modules.builtin"

	I1231 11:22:06.330341       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs"

	I1231 11:22:06.334575       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs_rr"

	I1231 11:22:06.338855       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs_wrr"

	I1231 11:22:06.342924       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs_sh"

	I1231 11:22:06.347232       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="nf_conntrack"

	I1231 11:22:06.433986       1 node.go:163] Successfully retrieved node IP: 192.168.49.2

	I1231 11:22:06.434204       1 server_others.go:138] "Detected node IP" address="192.168.49.2"

	I1231 11:22:06.434835       1 server_others.go:561] "Unknown proxy mode, assuming iptables proxy" proxyMode=""

	I1231 11:22:06.716109       1 server_others.go:206] "Using iptables Proxier"

	I1231 11:22:06.716372       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4

	I1231 11:22:06.716414       1 server_others.go:214] "Creating dualStackProxier for iptables"

	I1231 11:22:06.716624       1 server_others.go:491] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"

	I1231 11:22:06.718361       1 server.go:656] "Version info" version="v1.23.1"

	I1231 11:22:06.722154       1 config.go:317] "Starting service config controller"

	I1231 11:22:06.723022       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1231 11:22:06.722649       1 config.go:226] "Starting endpoint slice config controller"

	I1231 11:22:06.723514       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1231 11:22:06.824415       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I1231 11:22:06.824436       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-scheduler [59516730c193] <==

	* W1231 11:21:43.788202       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1231 11:21:43.788349       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W1231 11:21:43.832888       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1231 11:21:43.833005       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W1231 11:21:43.837588       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1231 11:21:43.837692       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W1231 11:21:43.868940       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1231 11:21:43.869067       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	W1231 11:21:44.088882       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1231 11:21:44.089013       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W1231 11:21:44.148556       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E1231 11:21:44.148722       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W1231 11:21:44.166924       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1231 11:21:44.167196       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W1231 11:21:44.206891       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1231 11:21:44.207006       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W1231 11:21:44.217132       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1231 11:21:44.217352       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W1231 11:21:44.253843       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1231 11:21:44.253997       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W1231 11:21:44.338017       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1231 11:21:44.338162       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W1231 11:21:45.526567       1 reflector.go:324] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1231 11:21:45.526774       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	I1231 11:21:51.740417       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-12-31 11:20:35 UTC, end at Fri 2021-12-31 11:25:21 UTC. --

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942451    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/61a858f6d0a505095df4f4e361b4fe99-etc-ca-certificates\") pod \"kube-apiserver-pause-20211231111903-1576\" (UID: \"61a858f6d0a505095df4f4e361b4fe99\") " pod="kube-system/kube-apiserver-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942525    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/61a858f6d0a505095df4f4e361b4fe99-usr-share-ca-certificates\") pod \"kube-apiserver-pause-20211231111903-1576\" (UID: \"61a858f6d0a505095df4f4e361b4fe99\") " pod="kube-system/kube-apiserver-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942571    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/1825a520-13e0-4474-a4e0-67a41d7c78c6-kube-proxy\") pod \"kube-proxy-zqfxj\" (UID: \"1825a520-13e0-4474-a4e0-67a41d7c78c6\") " pod="kube-system/kube-proxy-zqfxj"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942635    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f-config-volume\") pod \"coredns-64897985d-rv9pb\" (UID: \"dbdc4b7e-88ba-4ba8-ac2d-da20095dcc4f\") " pod="kube-system/coredns-64897985d-rv9pb"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942675    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/b045595f-407a-448d-b07b-49071722a847-tmp\") pod \"storage-provisioner\" (UID: \"b045595f-407a-448d-b07b-49071722a847\") " pod="kube-system/storage-provisioner"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942719    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/61a858f6d0a505095df4f4e361b4fe99-ca-certs\") pod \"kube-apiserver-pause-20211231111903-1576\" (UID: \"61a858f6d0a505095df4f4e361b4fe99\") " pod="kube-system/kube-apiserver-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942879    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/61a858f6d0a505095df4f4e361b4fe99-usr-local-share-ca-certificates\") pod \"kube-apiserver-pause-20211231111903-1576\" (UID: \"61a858f6d0a505095df4f4e361b4fe99\") " pod="kube-system/kube-apiserver-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.942959    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/1b44de50cea5ab5eb4c4156cdbe670e2-kubeconfig\") pod \"kube-scheduler-pause-20211231111903-1576\" (UID: \"1b44de50cea5ab5eb4c4156cdbe670e2\") " pod="kube-system/kube-scheduler-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943023    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/10435ba0d5da11c3134135f4e5f33b73-flexvolume-dir\") pod \"kube-controller-manager-pause-20211231111903-1576\" (UID: \"10435ba0d5da11c3134135f4e5f33b73\") " pod="kube-system/kube-controller-manager-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943109    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/10435ba0d5da11c3134135f4e5f33b73-k8s-certs\") pod \"kube-controller-manager-pause-20211231111903-1576\" (UID: \"10435ba0d5da11c3134135f4e5f33b73\") " pod="kube-system/kube-controller-manager-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943188    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/10435ba0d5da11c3134135f4e5f33b73-kubeconfig\") pod \"kube-controller-manager-pause-20211231111903-1576\" (UID: \"10435ba0d5da11c3134135f4e5f33b73\") " pod="kube-system/kube-controller-manager-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943235    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1825a520-13e0-4474-a4e0-67a41d7c78c6-lib-modules\") pod \"kube-proxy-zqfxj\" (UID: \"1825a520-13e0-4474-a4e0-67a41d7c78c6\") " pod="kube-system/kube-proxy-zqfxj"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943280    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-certs\" (UniqueName: \"kubernetes.io/host-path/ab6596944a7a3af683b87c004de894f8-etcd-certs\") pod \"etcd-pause-20211231111903-1576\" (UID: \"ab6596944a7a3af683b87c004de894f8\") " pod="kube-system/etcd-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943327    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/10435ba0d5da11c3134135f4e5f33b73-ca-certs\") pod \"kube-controller-manager-pause-20211231111903-1576\" (UID: \"10435ba0d5da11c3134135f4e5f33b73\") " pod="kube-system/kube-controller-manager-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943395    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/10435ba0d5da11c3134135f4e5f33b73-etc-ca-certificates\") pod \"kube-controller-manager-pause-20211231111903-1576\" (UID: \"10435ba0d5da11c3134135f4e5f33b73\") " pod="kube-system/kube-controller-manager-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943444    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz989\" (UniqueName: \"kubernetes.io/projected/1825a520-13e0-4474-a4e0-67a41d7c78c6-kube-api-access-nz989\") pod \"kube-proxy-zqfxj\" (UID: \"1825a520-13e0-4474-a4e0-67a41d7c78c6\") " pod="kube-system/kube-proxy-zqfxj"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943489    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54z9w\" (UniqueName: \"kubernetes.io/projected/b045595f-407a-448d-b07b-49071722a847-kube-api-access-54z9w\") pod \"storage-provisioner\" (UID: \"b045595f-407a-448d-b07b-49071722a847\") " pod="kube-system/storage-provisioner"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943573    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/61a858f6d0a505095df4f4e361b4fe99-k8s-certs\") pod \"kube-apiserver-pause-20211231111903-1576\" (UID: \"61a858f6d0a505095df4f4e361b4fe99\") " pod="kube-system/kube-apiserver-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943686    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/10435ba0d5da11c3134135f4e5f33b73-usr-share-ca-certificates\") pod \"kube-controller-manager-pause-20211231111903-1576\" (UID: \"10435ba0d5da11c3134135f4e5f33b73\") " pod="kube-system/kube-controller-manager-pause-20211231111903-1576"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.943947    4115 reconciler.go:216] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/1825a520-13e0-4474-a4e0-67a41d7c78c6-xtables-lock\") pod \"kube-proxy-zqfxj\" (UID: \"1825a520-13e0-4474-a4e0-67a41d7c78c6\") " pod="kube-system/kube-proxy-zqfxj"

	Dec 31 11:23:52 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:52.944006    4115 reconciler.go:157] "Reconciler: start to sync state"

	Dec 31 11:23:58 pause-20211231111903-1576 kubelet[4115]: I1231 11:23:58.137379    4115 dynamic_cafile_content.go:170] "Shutting down controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	Dec 31 11:23:58 pause-20211231111903-1576 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...

	Dec 31 11:23:58 pause-20211231111903-1576 systemd[1]: kubelet.service: Succeeded.

	Dec 31 11:23:58 pause-20211231111903-1576 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* 

	* ==> storage-provisioner [f058545bad9d] <==

	* 	/usr/local/go/src/sync/cond.go:56 +0x99

	k8s.io/client-go/util/workqueue.(*Type).Get(0xc0000b8420, 0x0, 0x0, 0x0)

		/Users/medya/go/pkg/mod/k8s.io/client-go@v0.20.5/util/workqueue/queue.go:145 +0x89

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextVolumeWorkItem(0xc0003eec80, 0x18e5530, 0xc00045ca00, 0x203000)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:990 +0x3e

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runVolumeWorker(...)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:929

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.3()

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x5c

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00057e2c0)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:155 +0x5f

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00057e2c0, 0x18b3d60, 0xc000320cf0, 0x1, 0xc000108540)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:156 +0x9b

	k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00057e2c0, 0x3b9aca00, 0x0, 0x1, 0xc000108540)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:133 +0x98

	k8s.io/apimachinery/pkg/util/wait.Until(0xc00057e2c0, 0x3b9aca00, 0xc000108540)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:90 +0x4d

	created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x3d6

	goroutine 108 [runnable]:

	k8s.io/client-go/tools/record.(*recorderImpl).generateEvent.func1(0xc00053c2c0, 0xc000160a00)

		/Users/medya/go/pkg/mod/k8s.io/client-go@v0.20.5/tools/record/event.go:341

	created by k8s.io/client-go/tools/record.(*recorderImpl).generateEvent

		/Users/medya/go/pkg/mod/k8s.io/client-go@v0.20.5/tools/record/event.go:341 +0x3b7

-- /stdout --

** stderr ** 

	E1231 11:25:20.955476    4144 logs.go:192] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	Unable to connect to the server: net/http: TLS handshake timeout

	 output: "\n** stderr ** \nUnable to connect to the server: net/http: TLS handshake timeout\n\n** /stderr **"

	! unable to fetch logs for: describe nodes

** /stderr **

=== CONT  TestPause/serial/PauseAgain

helpers_test.go:255: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.APIServer}} -p pause-20211231111903-1576 -n pause-20211231111903-1576

=== CONT  TestPause/serial/PauseAgain

helpers_test.go:255: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p pause-20211231111903-1576 -n pause-20211231111903-1576: exit status 2 (7.9403294s)

-- stdout --

	Paused

-- /stdout --

helpers_test.go:255: status error: exit status 2 (may be ok)

helpers_test.go:257: "pause-20211231111903-1576" apiserver is not running, skipping kubectl commands (state="Paused")

--- FAIL: TestPause/serial/PauseAgain (99.07s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Run:  out/minikube-windows-amd64.exe start -p default-k8s-different-port-20211231113947-1576 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --kubernetes-version=v1.23.1

=== CONT  TestStartStop/group/default-k8s-different-port/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p default-k8s-different-port-20211231113947-1576 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --kubernetes-version=v1.23.1: exit status 80 (1m1.3655408s)

-- stdout --

	* [default-k8s-different-port-20211231113947-1576] minikube v1.24.0 on Microsoft Windows 10 Enterprise N 10.0.18363 Build 18363

	  - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	  - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	  - MINIKUBE_LOCATION=12739

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	* Using the docker driver based on existing profile

	* Starting control plane node default-k8s-different-port-20211231113947-1576 in cluster default-k8s-different-port-20211231113947-1576

	* Pulling base image ...

	* Restarting existing docker container for "default-k8s-different-port-20211231113947-1576" ...

	* Restarting existing docker container for "default-k8s-different-port-20211231113947-1576" ...

-- /stdout --

** stderr ** 

	I1231 11:43:46.819214   10808 out.go:297] Setting OutFile to fd 1544 ...

	I1231 11:43:46.884558   10808 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 11:43:46.884558   10808 out.go:310] Setting ErrFile to fd 1668...

	I1231 11:43:46.884558   10808 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1231 11:43:46.898913   10808 out.go:304] Setting JSON to false

	I1231 11:43:46.901361   10808 start.go:112] hostinfo: {"hostname":"minikube7","uptime":37467,"bootTime":1640913559,"procs":154,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.18363 Build 18363","kernelVersion":"10.0.18363 Build 18363","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f66ed2ea-6c04-4a6b-8eea-b2fb0953e990"}

	W1231 11:43:46.901361   10808 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1231 11:43:46.906819   10808 out.go:176] * [default-k8s-different-port-20211231113947-1576] minikube v1.24.0 on Microsoft Windows 10 Enterprise N 10.0.18363 Build 18363

	I1231 11:43:46.906819   10808 notify.go:174] Checking for updates...

	I1231 11:43:46.912482   10808 out.go:176]   - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I1231 11:43:46.925465   10808 out.go:176]   - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	I1231 11:43:46.928930   10808 out.go:176]   - MINIKUBE_LOCATION=12739

	I1231 11:43:46.932439   10808 out.go:176]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1231 11:43:46.933338   10808 config.go:176] Loaded profile config "default-k8s-different-port-20211231113947-1576": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.1

	I1231 11:43:46.934249   10808 driver.go:344] Setting default libvirt URI to qemu:///system

	I1231 11:43:49.616998   10808 docker.go:132] docker version: linux-20.10.11

	I1231 11:43:49.625230   10808 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:43:52.016132   10808 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.3908912s)

	I1231 11:43:52.016132   10808 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:3 ContainersRunning:1 ContainersPaused:0 ContainersStopped:2 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:64 OomKillDisable:true NGoroutines:54 SystemTime:2021-12-31 11:43:50.8041988 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_

bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:43:52.019142   10808 out.go:176] * Using the docker driver based on existing profile

	I1231 11:43:52.020197   10808 start.go:280] selected driver: docker

	I1231 11:43:52.020197   10808 start.go:795] validating driver "docker" against &{Name:default-k8s-different-port-20211231113947-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.1 ClusterName:default-k8s-different-port-20211231113947-1

576 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8444 KubernetesVersion:v1.23.1 ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.3.1@sha256:ec27f462cf1946220f5a9ace416a84a57c18f98c777876a8054405d1428cc92e MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:tr

ue extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker}

	I1231 11:43:52.020197   10808 start.go:806] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I1231 11:43:52.020197   10808 start.go:1498] auto setting extra-config to "kubelet.global-housekeeping-interval=60m".

	I1231 11:43:52.020197   10808 start.go:1498] auto setting extra-config to "kubelet.housekeeping-interval=5m".

	I1231 11:43:52.166007   10808 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:43:54.714954   10808 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.5489362s)

	I1231 11:43:54.715322   10808 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:61 OomKillDisable:true NGoroutines:50 SystemTime:2021-12-31 11:43:53.5189866 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_

bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:43:54.715322   10808 start_flags.go:810] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1231 11:43:54.715322   10808 cni.go:93] Creating CNI manager for ""

	I1231 11:43:54.715322   10808 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1231 11:43:54.715853   10808 start_flags.go:298] config:

	{Name:default-k8s-different-port-20211231113947-1576 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.1 ClusterName:default-k8s-different-port-20211231113947-1576 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]

DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:global-housekeeping-interval Value:60m} {Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8444 KubernetesVersion:v1.23.1 ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.3.1@sha256:ec27f462cf1946220f5a9ace416a84a57c18f98c777876a8054405d1428cc92e MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m

0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker}

	I1231 11:43:54.723241   10808 out.go:176] * Starting control plane node default-k8s-different-port-20211231113947-1576 in cluster default-k8s-different-port-20211231113947-1576

	I1231 11:43:54.723401   10808 cache.go:118] Beginning downloading kic base image for docker with docker

	I1231 11:43:54.727266   10808 out.go:176] * Pulling base image ...

	I1231 11:43:54.727266   10808 preload.go:132] Checking if preload exists for k8s version v1.23.1 and runtime docker

	I1231 11:43:54.727266   10808 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b in local docker daemon

	I1231 11:43:54.727266   10808 preload.go:148] Found local preload: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.1-docker-overlay2-amd64.tar.lz4

	I1231 11:43:54.727266   10808 cache.go:57] Caching tarball of preloaded images

	I1231 11:43:54.728391   10808 preload.go:174] Found C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v16-v1.23.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1231 11:43:54.728391   10808 cache.go:60] Finished verifying existence of preloaded tar for  v1.23.1 on docker

	I1231 11:43:54.729148   10808 profile.go:147] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\default-k8s-different-port-20211231113947-1576\config.json ...

	I1231 11:43:56.108641   10808 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b in local docker daemon, skipping pull

	I1231 11:43:56.108705   10808 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b exists in daemon, skipping load

	I1231 11:43:56.108705   10808 cache.go:206] Successfully downloaded all kic artifacts

	I1231 11:43:56.108861   10808 start.go:313] acquiring machines lock for default-k8s-different-port-20211231113947-1576: {Name:mk17edddb79115da08708c92c50bc6cb1ee15fb6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1231 11:43:56.109078   10808 start.go:317] acquired machines lock for "default-k8s-different-port-20211231113947-1576" in 216.4µs

	I1231 11:43:56.109278   10808 start.go:93] Skipping create...Using existing machine configuration

	I1231 11:43:56.109316   10808 fix.go:55] fixHost starting: 

	I1231 11:43:56.124581   10808 cli_runner.go:133] Run: docker container inspect default-k8s-different-port-20211231113947-1576 --format={{.State.Status}}

	I1231 11:43:57.471055   10808 cli_runner.go:186] Completed: docker container inspect default-k8s-different-port-20211231113947-1576 --format={{.State.Status}}: (1.3463797s)

	I1231 11:43:57.471055   10808 fix.go:108] recreateIfNeeded on default-k8s-different-port-20211231113947-1576: state=Stopped err=<nil>

	W1231 11:43:57.471055   10808 fix.go:134] unexpected machine state, will restart: <nil>

	I1231 11:43:57.478051   10808 out.go:176] * Restarting existing docker container for "default-k8s-different-port-20211231113947-1576" ...

	I1231 11:43:57.483064   10808 cli_runner.go:133] Run: docker start default-k8s-different-port-20211231113947-1576

	W1231 11:44:03.875147   10808 cli_runner.go:180] docker start default-k8s-different-port-20211231113947-1576 returned with exit code 1

	I1231 11:44:03.875147   10808 cli_runner.go:186] Completed: docker start default-k8s-different-port-20211231113947-1576: (6.3920551s)

	I1231 11:44:03.882151   10808 cli_runner.go:133] Run: docker inspect default-k8s-different-port-20211231113947-1576

	I1231 11:44:05.387041   10808 cli_runner.go:186] Completed: docker inspect default-k8s-different-port-20211231113947-1576: (1.5048834s)

	I1231 11:44:05.387169   10808 errors.go:84] Postmortem inspect ("docker inspect default-k8s-different-port-20211231113947-1576"): -- stdout --

	[

	    {

	        "Id": "11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106",

	        "Created": "2021-12-31T11:40:54.5144635Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "exited",

	            "Running": false,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 0,

	            "ExitCode": 130,

	            "Error": "network 28f2b467e2029f6c69bcf00096c983d688568193b5931ffd81919f4d2577d2d5 not found",

	            "StartedAt": "2021-12-31T11:40:58.2322175Z",

	            "FinishedAt": "2021-12-31T11:43:34.3564494Z"

	        },

	        "Image": "sha256:64d09634c60d2a75596bc705aa84bdc41f76fe47c5d9ee362550bffbdc256979",

	        "ResolvConfPath": "/var/lib/docker/containers/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106/hostname",

	        "HostsPath": "/var/lib/docker/containers/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106/hosts",

	        "LogPath": "/var/lib/docker/containers/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106-json.log",

	        "Name": "/default-k8s-different-port-20211231113947-1576",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "default-k8s-different-port-20211231113947-1576:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "default-k8s-different-port-20211231113947-1576",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8444/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2306867200,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                {

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

	                }

	            ],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 2306867200,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/360bd4e7ed2df2c7db9344ab61b1d38661276023bee06c9c05b655772766af89-init/diff:/var/lib/docker/overlay2/236e34868c6bd5ecc10a009188d3dd414c10322ed61f0f8bd2f0cc6afe31d4a2/diff:/var/lib/docker/overlay2/4f26d83e8780f057af23a45796afe2feeb4c6225d04f3e75d86d76ce33e6eeb7/diff:/var/lib/docker/overlay2/1aa2f7df6f61654ba127b3d7ca8e4c7c9faa9ea133a905aee86c5c729b50580e/diff:/var/lib/docker/overlay2/810f58a572d447e357f0e37fcb6e434743ec2c41f1a828b80ea35481ad056b01/diff:/var/lib/docker/overlay2/0f8aaf037fa7c7675cf275f7d2ec3ea76e658acf5a3dab8397689e8f0f123d26/diff:/var/lib/docker/overlay2/be7ae9f76a1638260aab5f1fa7ff3040af697c9a44380f0cc9d6b9f8e13fc3d0/diff:/var/lib/docker/overlay2/ef02c9f68049a2b4bbb3c853a879f858f696367e0e4a0cd3c8f8a560cf64f559/diff:/var/lib/docker/overlay2/35131ade500d28bbea06e314019475aaefc896faf010312fe4a992789b633265/diff:/var/lib/docker/overlay2/8d9649b172e37864a9f036c4de74b67ea5b01978cffc6a9362049d5ea5d6f55d/diff:/var/lib/docker/overlay2/52868f

77169cdf9bc78bcde8ac7ec95f1a8185a6302edb584dbf9a6360daf03a/diff:/var/lib/docker/overlay2/f8c18464f7aef662c8d4ad84d2451d43835e5f4569a4d2b9f30ad97322903d11/diff:/var/lib/docker/overlay2/0101fb0a80bf47a589e85bb95fd060770df32c7a11dbd8a7dcfef4d9d01f8af2/diff:/var/lib/docker/overlay2/07d0477dc6604496cacf7ed9c358a06fe7d29546c33411fecdaf0ecaa2a9a0ef/diff:/var/lib/docker/overlay2/3f31c6e0e5aac9e858d82dd03ebea66448458f5a927add3f654a304d2c37e502/diff:/var/lib/docker/overlay2/d7ed3b53a0a390071295a19edc1e7d6c00a99dfe061348b28a62f8b9a82318d0/diff:/var/lib/docker/overlay2/3b636a10aa41811f93fe647f4a2254548b80bdeb098c8533b22c4d79d53fcdf0/diff:/var/lib/docker/overlay2/ce837cfcf557adff25b0b4b5f4d6f01e0cf5a1b8bb23ee431d224975cacbe2b0/diff:/var/lib/docker/overlay2/3605fc7a2584009be0a2860c72bef0b598b9bc1f266a398074b7c8a7123333b1/diff:/var/lib/docker/overlay2/05a27701432d46329015577bf385d007c4190625712f8101bb39d9a5744fae1b/diff:/var/lib/docker/overlay2/c25e37734ac3910f77446ef67a386f29de76d35b911b15e745ab7622def0e089/diff:/var/lib/d

ocker/overlay2/a8e782b00e5454fb7d4ededfc9896090aac72e1b0b4c00e43cc9e0bdcf4d2906/diff:/var/lib/docker/overlay2/44c82f3c0e578428d3d9bd874ec44bdd533b0d6845072a4aac19be4720565273/diff:/var/lib/docker/overlay2/14d59fa1343c7e69048f262f4f3f304832c41b33f9f6b5d17a01d67b6c488996/diff:/var/lib/docker/overlay2/15c980de9f5f13135282866b74e142b0c02c48a68d5b570fdb352734d154c43c/diff:/var/lib/docker/overlay2/82368a0688767ffd3b7eb2fd7f8cf27704e4ae4f7ecbb8b8b73f437e928c0db7/diff:/var/lib/docker/overlay2/e976758fe64d0a07d050f840cfff6da24646e500eb0758ad525eec4402c332fb/diff:/var/lib/docker/overlay2/74148e6df6795f39b3025653e1114d8d16999f340f4ace621d5d37e82a3698fe/diff:/var/lib/docker/overlay2/05e29b3eb2babc45b9101583a4b8dc9c219237c4297f0678b648a934cd2cf604/diff:/var/lib/docker/overlay2/d7cae5db557577bece8070136b11e87052bce1263acb0b687e90567746b09f61/diff:/var/lib/docker/overlay2/5b1ff4405c06a77b96c7b61fbf1df81004551144d651ae61b632dfc3b269bc76/diff:/var/lib/docker/overlay2/f50ff6635032640d426a42ecb016d73fdb96ba15505a1ae4f01d7cb3315

925fb/diff:/var/lib/docker/overlay2/72f65c380012ae92d0675a1b93218ad4ecd8addccb3371324d814fa248daed27/diff:/var/lib/docker/overlay2/b1c4ea370005cb0ea474c83801a0ba4b376d83bfe171b465e61eeab9fbd46b68/diff:/var/lib/docker/overlay2/182b2273f71a8695b8a041e54bb701488b71028091c701a3271bdf6fd0f2c5f5/diff:/var/lib/docker/overlay2/31812fd31cbde39dd1044b048c3f74540d47fbb1dd15634a350ede4f6725dea5/diff:/var/lib/docker/overlay2/58541d8dc75e6a2ece804245b92e88e76345bdbbdda996fbd757eb2290e3e609/diff:/var/lib/docker/overlay2/207a2c171a9595e78850f4fe19c5e78e337c2201f45a4cebc01f869ca7eecf54/diff:/var/lib/docker/overlay2/93569597c37885046de0762af7ba9d6379d54b5533be30cc27f514859f28f7ba/diff:/var/lib/docker/overlay2/57f04579d4692224f2cabd08068218468a37e48174920084405ce9ae88d5d7a7/diff:/var/lib/docker/overlay2/db96b3bbab3bd95dcee0936a5ab318b82dcc941cc09c1fd201e21d97dd5d7617/diff:/var/lib/docker/overlay2/0560b92e88427b3710f730d81a8d910fa8c7feee2a4273c4abb5c51364213d07/diff:/var/lib/docker/overlay2/4e3f380bd40064fcfb56a83f831a38ef53e4ea

bbf36f7661d063e55ccf2972c0/diff:/var/lib/docker/overlay2/65534d10a48ed16cb8b24cc817d40ad1c80c0bbb261a2b966fb4e1bac0f2b524/diff:/var/lib/docker/overlay2/799e74a4ab0cf4fb970c0d6f14af7e37410bf1168fcb40d81c85c773f406f235/diff",

	                "MergedDir": "/var/lib/docker/overlay2/360bd4e7ed2df2c7db9344ab61b1d38661276023bee06c9c05b655772766af89/merged",

	                "UpperDir": "/var/lib/docker/overlay2/360bd4e7ed2df2c7db9344ab61b1d38661276023bee06c9c05b655772766af89/diff",

	                "WorkDir": "/var/lib/docker/overlay2/360bd4e7ed2df2c7db9344ab61b1d38661276023bee06c9c05b655772766af89/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "default-k8s-different-port-20211231113947-1576",

	                "Source": "/var/lib/docker/volumes/default-k8s-different-port-20211231113947-1576/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "default-k8s-different-port-20211231113947-1576",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8444/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "default-k8s-different-port-20211231113947-1576",

	                "name.minikube.sigs.k8s.io": "default-k8s-different-port-20211231113947-1576",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "aaf3b09ad27e886c553df33c0beee25d2ce62859bd45339fbcf09556183a5f3a",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {},

	            "SandboxKey": "/var/run/docker/netns/aaf3b09ad27e",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "default-k8s-different-port-20211231113947-1576": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.67.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "11225af84302",

	                        "default-k8s-different-port-20211231113947-1576"

	                    ],

	                    "NetworkID": "28f2b467e2029f6c69bcf00096c983d688568193b5931ffd81919f4d2577d2d5",

	                    "EndpointID": "",

	                    "Gateway": "",

	                    "IPAddress": "",

	                    "IPPrefixLen": 0,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

	-- /stdout --

	I1231 11:44:05.398608   10808 cli_runner.go:133] Run: docker logs --timestamps --details default-k8s-different-port-20211231113947-1576

	I1231 11:44:06.807072   10808 cli_runner.go:186] Completed: docker logs --timestamps --details default-k8s-different-port-20211231113947-1576: (1.4083678s)

	I1231 11:44:06.807072   10808 errors.go:91] Postmortem logs ("docker logs --timestamps --details default-k8s-different-port-20211231113947-1576"): -- stdout --

	2021-12-31T11:40:58.230178100Z  + userns=

	2021-12-31T11:40:58.230236200Z  + grep -Eqv '0[[:space:]]+0[[:space:]]+4294967295' /proc/self/uid_map

	2021-12-31T11:40:58.237384200Z  + validate_userns

	2021-12-31T11:40:58.237413800Z  + [[ -z '' ]]

	2021-12-31T11:40:58.237433200Z  + return

	2021-12-31T11:40:58.237440800Z  + configure_containerd

	2021-12-31T11:40:58.239334400Z  ++ stat -f -c %T /kind

	2021-12-31T11:40:58.246035300Z  + [[ overlayfs == \z\f\s ]]

	2021-12-31T11:40:58.246063600Z  + configure_proxy

	2021-12-31T11:40:58.246074500Z  + mkdir -p /etc/systemd/system.conf.d/

	2021-12-31T11:40:58.250624400Z  + [[ ! -z '' ]]

	2021-12-31T11:40:58.250650500Z  + cat

	2021-12-31T11:40:58.253663000Z  + fix_kmsg

	2021-12-31T11:40:58.253956400Z  + [[ ! -e /dev/kmsg ]]

	2021-12-31T11:40:58.253975500Z  + fix_mount

	2021-12-31T11:40:58.253983200Z  + echo 'INFO: ensuring we can execute mount/umount even with userns-remap'

	2021-12-31T11:40:58.253989200Z  INFO: ensuring we can execute mount/umount even with userns-remap

	2021-12-31T11:40:58.253995100Z  ++ which mount

	2021-12-31T11:40:58.256893700Z  ++ which umount

	2021-12-31T11:40:58.258891600Z  + chown root:root /usr/bin/mount /usr/bin/umount

	2021-12-31T11:40:58.350980700Z  ++ which mount

	2021-12-31T11:40:58.353302200Z  ++ which umount

	2021-12-31T11:40:58.354949900Z  + chmod -s /usr/bin/mount /usr/bin/umount

	2021-12-31T11:40:58.358145500Z  +++ which mount

	2021-12-31T11:40:58.359710900Z  ++ stat -f -c %T /usr/bin/mount

	2021-12-31T11:40:58.361789200Z  + [[ overlayfs == \a\u\f\s ]]

	2021-12-31T11:40:58.361889500Z  + [[ -z '' ]]

	2021-12-31T11:40:58.361902000Z  + echo 'INFO: remounting /sys read-only'

	2021-12-31T11:40:58.361908300Z  INFO: remounting /sys read-only

	2021-12-31T11:40:58.361914300Z  + mount -o remount,ro /sys

	2021-12-31T11:40:58.365039800Z  + echo 'INFO: making mounts shared'

	2021-12-31T11:40:58.365056600Z  INFO: making mounts shared

	2021-12-31T11:40:58.365061100Z  + mount --make-rshared /

	2021-12-31T11:40:58.367254800Z  + retryable_fix_cgroup

	2021-12-31T11:40:58.367833300Z  ++ seq 0 10

	2021-12-31T11:40:58.369227300Z  + for i in $(seq 0 10)

	2021-12-31T11:40:58.369249700Z  + fix_cgroup

	2021-12-31T11:40:58.369254100Z  + [[ -f /sys/fs/cgroup/cgroup.controllers ]]

	2021-12-31T11:40:58.369257900Z  + echo 'INFO: detected cgroup v1'

	2021-12-31T11:40:58.369261500Z  INFO: detected cgroup v1

	2021-12-31T11:40:58.369264900Z  + echo 'INFO: fix cgroup mounts for all subsystems'

	2021-12-31T11:40:58.369268600Z  INFO: fix cgroup mounts for all subsystems

	2021-12-31T11:40:58.369285700Z  + local current_cgroup

	2021-12-31T11:40:58.371127300Z  ++ grep -E '^[^:]*:([^:]*,)?cpu(,[^,:]*)?:.*' /proc/self/cgroup

	2021-12-31T11:40:58.371152200Z  ++ cut -d: -f3

	2021-12-31T11:40:58.373304800Z  + current_cgroup=/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.373322900Z  + local cgroup_subsystems

	2021-12-31T11:40:58.374775900Z  ++ findmnt -lun -o source,target -t cgroup

	2021-12-31T11:40:58.374797300Z  ++ grep /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.374890600Z  ++ awk '{print $2}'

	2021-12-31T11:40:58.378796600Z  + cgroup_subsystems='/sys/fs/cgroup/cpuset

	2021-12-31T11:40:58.378882500Z  /sys/fs/cgroup/cpu

	2021-12-31T11:40:58.378896900Z  /sys/fs/cgroup/cpuacct

	2021-12-31T11:40:58.378903600Z  /sys/fs/cgroup/blkio

	2021-12-31T11:40:58.378909200Z  /sys/fs/cgroup/memory

	2021-12-31T11:40:58.378914900Z  /sys/fs/cgroup/devices

	2021-12-31T11:40:58.378920400Z  /sys/fs/cgroup/freezer

	2021-12-31T11:40:58.378925900Z  /sys/fs/cgroup/net_cls

	2021-12-31T11:40:58.378930100Z  /sys/fs/cgroup/perf_event

	2021-12-31T11:40:58.378933300Z  /sys/fs/cgroup/net_prio

	2021-12-31T11:40:58.378936500Z  /sys/fs/cgroup/hugetlb

	2021-12-31T11:40:58.378939700Z  /sys/fs/cgroup/pids

	2021-12-31T11:40:58.379022700Z  /sys/fs/cgroup/systemd'

	2021-12-31T11:40:58.379028400Z  + local cgroup_mounts

	2021-12-31T11:40:58.379588800Z  ++ grep -E -o '/[[:alnum:]].* /sys/fs/cgroup.*.*cgroup' /proc/self/mountinfo

	2021-12-31T11:40:58.382754800Z  + cgroup_mounts='/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime shared:242 master:53 - cgroup

	2021-12-31T11:40:58.382777900Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpu rw,nosuid,nodev,noexec,relatime shared:245 master:54 - cgroup

	2021-12-31T11:40:58.382785800Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpuacct rw,nosuid,nodev,noexec,relatime shared:246 master:55 - cgroup

	2021-12-31T11:40:58.382791800Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime shared:247 master:56 - cgroup

	2021-12-31T11:40:58.382798300Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime shared:248 master:57 - cgroup

	2021-12-31T11:40:58.382804200Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime shared:249 master:58 - cgroup

	2021-12-31T11:40:58.382810200Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime shared:250 master:59 - cgroup

	2021-12-31T11:40:58.382816200Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/net_cls rw,nosuid,nodev,noexec,relatime shared:251 master:60 - cgroup

	2021-12-31T11:40:58.382835800Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime shared:252 master:61 - cgroup

	2021-12-31T11:40:58.382842000Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/net_prio rw,nosuid,nodev,noexec,relatime shared:264 master:62 - cgroup

	2021-12-31T11:40:58.382845700Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/hugetlb rw,nosuid,nodev,noexec,relatime shared:265 master:63 - cgroup

	2021-12-31T11:40:58.382849100Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/pids rw,nosuid,nodev,noexec,relatime shared:266 master:64 - cgroup

	2021-12-31T11:40:58.382854100Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/systemd rw,nosuid,nodev,noexec,relatime shared:268 master:66 - cgroup cgroup'

	2021-12-31T11:40:58.382857800Z  + [[ -n /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime shared:242 master:53 - cgroup

	2021-12-31T11:40:58.382861200Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpu rw,nosuid,nodev,noexec,relatime shared:245 master:54 - cgroup

	2021-12-31T11:40:58.382864700Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpuacct rw,nosuid,nodev,noexec,relatime shared:246 master:55 - cgroup

	2021-12-31T11:40:58.382868100Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime shared:247 master:56 - cgroup

	2021-12-31T11:40:58.382871500Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime shared:248 master:57 - cgroup

	2021-12-31T11:40:58.382874900Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime shared:249 master:58 - cgroup

	2021-12-31T11:40:58.382878200Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime shared:250 master:59 - cgroup

	2021-12-31T11:40:58.382881700Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/net_cls rw,nosuid,nodev,noexec,relatime shared:251 master:60 - cgroup

	2021-12-31T11:40:58.382885200Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime shared:252 master:61 - cgroup

	2021-12-31T11:40:58.382888500Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/net_prio rw,nosuid,nodev,noexec,relatime shared:264 master:62 - cgroup

	2021-12-31T11:40:58.382891900Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/hugetlb rw,nosuid,nodev,noexec,relatime shared:265 master:63 - cgroup

	2021-12-31T11:40:58.382895300Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/pids rw,nosuid,nodev,noexec,relatime shared:266 master:64 - cgroup

	2021-12-31T11:40:58.382899100Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/systemd rw,nosuid,nodev,noexec,relatime shared:268 master:66 - cgroup cgroup ]]

	2021-12-31T11:40:58.382925900Z  + local mount_root

	2021-12-31T11:40:58.383982400Z  ++ head -n 1

	2021-12-31T11:40:58.384022000Z  ++ cut '-d ' -f1

	2021-12-31T11:40:58.386130600Z  + mount_root=/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.387755400Z  ++ echo '/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime shared:242 master:53 - cgroup

	2021-12-31T11:40:58.387777100Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpu rw,nosuid,nodev,noexec,relatime shared:245 master:54 - cgroup

	2021-12-31T11:40:58.387786000Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpuacct rw,nosuid,nodev,noexec,relatime shared:246 master:55 - cgroup

	2021-12-31T11:40:58.387792700Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime shared:247 master:56 - cgroup

	2021-12-31T11:40:58.387799400Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime shared:248 master:57 - cgroup

	2021-12-31T11:40:58.387805900Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime shared:249 master:58 - cgroup

	2021-12-31T11:40:58.387812400Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime shared:250 master:59 - cgroup

	2021-12-31T11:40:58.387818600Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/net_cls rw,nosuid,nodev,noexec,relatime shared:251 master:60 - cgroup

	2021-12-31T11:40:58.387825100Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime shared:252 master:61 - cgroup

	2021-12-31T11:40:58.387831500Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/net_prio rw,nosuid,nodev,noexec,relatime shared:264 master:62 - cgroup

	2021-12-31T11:40:58.387837700Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/hugetlb rw,nosuid,nodev,noexec,relatime shared:265 master:63 - cgroup

	2021-12-31T11:40:58.387843600Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/pids rw,nosuid,nodev,noexec,relatime shared:266 master:64 - cgroup

	2021-12-31T11:40:58.387851900Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/systemd rw,nosuid,nodev,noexec,relatime shared:268 master:66 - cgroup cgroup'

	2021-12-31T11:40:58.387858700Z  ++ cut '-d ' -f 2

	2021-12-31T11:40:58.389970400Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.389993700Z  + local target=/sys/fs/cgroup/cpuset/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.390001100Z  + findmnt /sys/fs/cgroup/cpuset/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.393697000Z  + mkdir -p /sys/fs/cgroup/cpuset/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.451832900Z  + mount --bind /sys/fs/cgroup/cpuset /sys/fs/cgroup/cpuset/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.454302900Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.454323600Z  + local target=/sys/fs/cgroup/cpu/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.454332700Z  + findmnt /sys/fs/cgroup/cpu/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.457790700Z  + mkdir -p /sys/fs/cgroup/cpu/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.459841700Z  + mount --bind /sys/fs/cgroup/cpu /sys/fs/cgroup/cpu/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.462638900Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.462674600Z  + local target=/sys/fs/cgroup/cpuacct/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.462679900Z  + findmnt /sys/fs/cgroup/cpuacct/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.465594900Z  + mkdir -p /sys/fs/cgroup/cpuacct/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.467405800Z  + mount --bind /sys/fs/cgroup/cpuacct /sys/fs/cgroup/cpuacct/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.470290400Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.470314000Z  + local target=/sys/fs/cgroup/blkio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.470322400Z  + findmnt /sys/fs/cgroup/blkio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.473415000Z  + mkdir -p /sys/fs/cgroup/blkio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.475919500Z  + mount --bind /sys/fs/cgroup/blkio /sys/fs/cgroup/blkio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.478319800Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.478340800Z  + local target=/sys/fs/cgroup/memory/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.478349400Z  + findmnt /sys/fs/cgroup/memory/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.481839700Z  + mkdir -p /sys/fs/cgroup/memory/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.484986500Z  + mount --bind /sys/fs/cgroup/memory /sys/fs/cgroup/memory/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.488689800Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.488718400Z  + local target=/sys/fs/cgroup/devices/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.488751100Z  + findmnt /sys/fs/cgroup/devices/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.492095900Z  + mkdir -p /sys/fs/cgroup/devices/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.494106600Z  + mount --bind /sys/fs/cgroup/devices /sys/fs/cgroup/devices/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.496600700Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.496618300Z  + local target=/sys/fs/cgroup/freezer/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.496623500Z  + findmnt /sys/fs/cgroup/freezer/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.499486100Z  + mkdir -p /sys/fs/cgroup/freezer/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.501691500Z  + mount --bind /sys/fs/cgroup/freezer /sys/fs/cgroup/freezer/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.504126400Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.504148800Z  + local target=/sys/fs/cgroup/net_cls/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.504156900Z  + findmnt /sys/fs/cgroup/net_cls/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.507023300Z  + mkdir -p /sys/fs/cgroup/net_cls/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.508904300Z  + mount --bind /sys/fs/cgroup/net_cls /sys/fs/cgroup/net_cls/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.511018600Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.511053700Z  + local target=/sys/fs/cgroup/perf_event/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.511058500Z  + findmnt /sys/fs/cgroup/perf_event/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.515577400Z  + mkdir -p /sys/fs/cgroup/perf_event/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.517922100Z  + mount --bind /sys/fs/cgroup/perf_event /sys/fs/cgroup/perf_event/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.523537300Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.523562100Z  + local target=/sys/fs/cgroup/net_prio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.523578300Z  + findmnt /sys/fs/cgroup/net_prio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.528244400Z  + mkdir -p /sys/fs/cgroup/net_prio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.532132900Z  + mount --bind /sys/fs/cgroup/net_prio /sys/fs/cgroup/net_prio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.535266500Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.535307100Z  + local target=/sys/fs/cgroup/hugetlb/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.535315300Z  + findmnt /sys/fs/cgroup/hugetlb/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.539488600Z  + mkdir -p /sys/fs/cgroup/hugetlb/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.542214500Z  + mount --bind /sys/fs/cgroup/hugetlb /sys/fs/cgroup/hugetlb/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.544673200Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.544689400Z  + local target=/sys/fs/cgroup/pids/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.544715600Z  + findmnt /sys/fs/cgroup/pids/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.547587800Z  + mkdir -p /sys/fs/cgroup/pids/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.549557900Z  + mount --bind /sys/fs/cgroup/pids /sys/fs/cgroup/pids/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.552378100Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.552396400Z  + local target=/sys/fs/cgroup/systemd/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.552401300Z  + findmnt /sys/fs/cgroup/systemd/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.555303900Z  + mkdir -p /sys/fs/cgroup/systemd/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.557341900Z  + mount --bind /sys/fs/cgroup/systemd /sys/fs/cgroup/systemd/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.559481200Z  + mount --make-rprivate /sys/fs/cgroup

	2021-12-31T11:40:58.562480800Z  + echo '/sys/fs/cgroup/cpuset

	2021-12-31T11:40:58.562504200Z  /sys/fs/cgroup/cpu

	2021-12-31T11:40:58.562511800Z  /sys/fs/cgroup/cpuacct

	2021-12-31T11:40:58.562517400Z  /sys/fs/cgroup/blkio

	2021-12-31T11:40:58.562523100Z  /sys/fs/cgroup/memory

	2021-12-31T11:40:58.562528700Z  /sys/fs/cgroup/devices

	2021-12-31T11:40:58.562534000Z  /sys/fs/cgroup/freezer

	2021-12-31T11:40:58.562539600Z  /sys/fs/cgroup/net_cls

	2021-12-31T11:40:58.562545100Z  /sys/fs/cgroup/perf_event

	2021-12-31T11:40:58.562550200Z  /sys/fs/cgroup/net_prio

	2021-12-31T11:40:58.562556500Z  /sys/fs/cgroup/hugetlb

	2021-12-31T11:40:58.562562200Z  /sys/fs/cgroup/pids

	2021-12-31T11:40:58.562567900Z  /sys/fs/cgroup/systemd'

	2021-12-31T11:40:58.562573500Z  + IFS=

	2021-12-31T11:40:58.562578900Z  + read -r subsystem

	2021-12-31T11:40:58.563354900Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/cpuset

	2021-12-31T11:40:58.563376600Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.563383400Z  + local subsystem=/sys/fs/cgroup/cpuset

	2021-12-31T11:40:58.563389500Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.563395300Z  + mkdir -p /sys/fs/cgroup/cpuset//kubelet

	2021-12-31T11:40:58.565417800Z  + '[' /sys/fs/cgroup/cpuset == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.565461000Z  + cat /sys/fs/cgroup/cpuset/cpuset.cpus

	2021-12-31T11:40:58.568573000Z  + cat /sys/fs/cgroup/cpuset/cpuset.mems

	2021-12-31T11:40:58.570314400Z  + mount --bind /sys/fs/cgroup/cpuset//kubelet /sys/fs/cgroup/cpuset//kubelet

	2021-12-31T11:40:58.573149000Z  + IFS=

	2021-12-31T11:40:58.573184600Z  + read -r subsystem

	2021-12-31T11:40:58.573189500Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/cpu

	2021-12-31T11:40:58.573193100Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.573196400Z  + local subsystem=/sys/fs/cgroup/cpu

	2021-12-31T11:40:58.573199800Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.573203200Z  + mkdir -p /sys/fs/cgroup/cpu//kubelet

	2021-12-31T11:40:58.575555000Z  + '[' /sys/fs/cgroup/cpu == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.575578300Z  + mount --bind /sys/fs/cgroup/cpu//kubelet /sys/fs/cgroup/cpu//kubelet

	2021-12-31T11:40:58.578245500Z  + IFS=

	2021-12-31T11:40:58.578264600Z  + read -r subsystem

	2021-12-31T11:40:58.578272200Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/cpuacct

	2021-12-31T11:40:58.578279200Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.578285200Z  + local subsystem=/sys/fs/cgroup/cpuacct

	2021-12-31T11:40:58.578291100Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.578296800Z  + mkdir -p /sys/fs/cgroup/cpuacct//kubelet

	2021-12-31T11:40:58.580230100Z  + '[' /sys/fs/cgroup/cpuacct == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.580249600Z  + mount --bind /sys/fs/cgroup/cpuacct//kubelet /sys/fs/cgroup/cpuacct//kubelet

	2021-12-31T11:40:58.583058100Z  + IFS=

	2021-12-31T11:40:58.583074700Z  + read -r subsystem

	2021-12-31T11:40:58.583079100Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/blkio

	2021-12-31T11:40:58.583082900Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.583086400Z  + local subsystem=/sys/fs/cgroup/blkio

	2021-12-31T11:40:58.583564100Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.583580800Z  + mkdir -p /sys/fs/cgroup/blkio//kubelet

	2021-12-31T11:40:58.585467000Z  + '[' /sys/fs/cgroup/blkio == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.585483200Z  + mount --bind /sys/fs/cgroup/blkio//kubelet /sys/fs/cgroup/blkio//kubelet

	2021-12-31T11:40:58.588906600Z  + IFS=

	2021-12-31T11:40:58.588928500Z  + read -r subsystem

	2021-12-31T11:40:58.588952700Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/memory

	2021-12-31T11:40:58.588981500Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.588985100Z  + local subsystem=/sys/fs/cgroup/memory

	2021-12-31T11:40:58.590570900Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.590702100Z  + mkdir -p /sys/fs/cgroup/memory//kubelet

	2021-12-31T11:40:58.596832900Z  + '[' /sys/fs/cgroup/memory == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.596850000Z  + mount --bind /sys/fs/cgroup/memory//kubelet /sys/fs/cgroup/memory//kubelet

	2021-12-31T11:40:58.602341000Z  + IFS=

	2021-12-31T11:40:58.602364400Z  + read -r subsystem

	2021-12-31T11:40:58.602371300Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/devices

	2021-12-31T11:40:58.602377700Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.603911000Z  + local subsystem=/sys/fs/cgroup/devices

	2021-12-31T11:40:58.605155200Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.605175500Z  + mkdir -p /sys/fs/cgroup/devices//kubelet

	2021-12-31T11:40:58.608088300Z  + '[' /sys/fs/cgroup/devices == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.608111100Z  + mount --bind /sys/fs/cgroup/devices//kubelet /sys/fs/cgroup/devices//kubelet

	2021-12-31T11:40:58.610676600Z  + IFS=

	2021-12-31T11:40:58.610702600Z  + read -r subsystem

	2021-12-31T11:40:58.610728400Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/freezer

	2021-12-31T11:40:58.610736700Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.610744500Z  + local subsystem=/sys/fs/cgroup/freezer

	2021-12-31T11:40:58.610751600Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.610971400Z  + mkdir -p /sys/fs/cgroup/freezer//kubelet

	2021-12-31T11:40:58.613407000Z  + '[' /sys/fs/cgroup/freezer == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.613429200Z  + mount --bind /sys/fs/cgroup/freezer//kubelet /sys/fs/cgroup/freezer//kubelet

	2021-12-31T11:40:58.616622000Z  + IFS=

	2021-12-31T11:40:58.616642900Z  + read -r subsystem

	2021-12-31T11:40:58.616665200Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/net_cls

	2021-12-31T11:40:58.616691100Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.616696700Z  + local subsystem=/sys/fs/cgroup/net_cls

	2021-12-31T11:40:58.616701700Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.616706900Z  + mkdir -p /sys/fs/cgroup/net_cls//kubelet

	2021-12-31T11:40:58.621548000Z  + '[' /sys/fs/cgroup/net_cls == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.621576800Z  + mount --bind /sys/fs/cgroup/net_cls//kubelet /sys/fs/cgroup/net_cls//kubelet

	2021-12-31T11:40:58.627430600Z  + IFS=

	2021-12-31T11:40:58.627468600Z  + read -r subsystem

	2021-12-31T11:40:58.627475900Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/perf_event

	2021-12-31T11:40:58.627498000Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.627509800Z  + local subsystem=/sys/fs/cgroup/perf_event

	2021-12-31T11:40:58.627518300Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.627523700Z  + mkdir -p /sys/fs/cgroup/perf_event//kubelet

	2021-12-31T11:40:58.631747900Z  + '[' /sys/fs/cgroup/perf_event == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.631773900Z  + mount --bind /sys/fs/cgroup/perf_event//kubelet /sys/fs/cgroup/perf_event//kubelet

	2021-12-31T11:40:58.634905800Z  + IFS=

	2021-12-31T11:40:58.634927500Z  + read -r subsystem

	2021-12-31T11:40:58.634934100Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/net_prio

	2021-12-31T11:40:58.634940000Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.634945600Z  + local subsystem=/sys/fs/cgroup/net_prio

	2021-12-31T11:40:58.634951100Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.634956500Z  + mkdir -p /sys/fs/cgroup/net_prio//kubelet

	2021-12-31T11:40:58.637743300Z  + '[' /sys/fs/cgroup/net_prio == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.637766600Z  + mount --bind /sys/fs/cgroup/net_prio//kubelet /sys/fs/cgroup/net_prio//kubelet

	2021-12-31T11:40:58.641063700Z  + IFS=

	2021-12-31T11:40:58.641086500Z  + read -r subsystem

	2021-12-31T11:40:58.641093800Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/hugetlb

	2021-12-31T11:40:58.641099700Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.641105200Z  + local subsystem=/sys/fs/cgroup/hugetlb

	2021-12-31T11:40:58.641110600Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.641116500Z  + mkdir -p /sys/fs/cgroup/hugetlb//kubelet

	2021-12-31T11:40:58.643550900Z  + '[' /sys/fs/cgroup/hugetlb == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.643568300Z  + mount --bind /sys/fs/cgroup/hugetlb//kubelet /sys/fs/cgroup/hugetlb//kubelet

	2021-12-31T11:40:58.646328300Z  + IFS=

	2021-12-31T11:40:58.646369900Z  + read -r subsystem

	2021-12-31T11:40:58.646378000Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/pids

	2021-12-31T11:40:58.646388500Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.646397900Z  + local subsystem=/sys/fs/cgroup/pids

	2021-12-31T11:40:58.646404400Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.646899600Z  + mkdir -p /sys/fs/cgroup/pids//kubelet

	2021-12-31T11:40:58.648501100Z  + '[' /sys/fs/cgroup/pids == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.648515000Z  + mount --bind /sys/fs/cgroup/pids//kubelet /sys/fs/cgroup/pids//kubelet

	2021-12-31T11:40:58.651244800Z  + IFS=

	2021-12-31T11:40:58.651260000Z  + read -r subsystem

	2021-12-31T11:40:58.651264100Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/systemd

	2021-12-31T11:40:58.651267800Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.651271100Z  + local subsystem=/sys/fs/cgroup/systemd

	2021-12-31T11:40:58.651287200Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.651291000Z  + mkdir -p /sys/fs/cgroup/systemd//kubelet

	2021-12-31T11:40:58.653410900Z  + '[' /sys/fs/cgroup/systemd == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.653425200Z  + mount --bind /sys/fs/cgroup/systemd//kubelet /sys/fs/cgroup/systemd//kubelet

	2021-12-31T11:40:58.656129300Z  + IFS=

	2021-12-31T11:40:58.656149200Z  + read -r subsystem

	2021-12-31T11:40:58.656157300Z  + return

	2021-12-31T11:40:58.656162700Z  + fix_machine_id

	2021-12-31T11:40:58.656168500Z  + echo 'INFO: clearing and regenerating /etc/machine-id'

	2021-12-31T11:40:58.656173900Z  INFO: clearing and regenerating /etc/machine-id

	2021-12-31T11:40:58.656179500Z  + rm -f /etc/machine-id

	2021-12-31T11:40:58.658858200Z  + systemd-machine-id-setup

	2021-12-31T11:40:58.665514400Z  Initializing machine ID from D-Bus machine ID.

	2021-12-31T11:40:58.680704800Z  + fix_product_name

	2021-12-31T11:40:58.680723800Z  + [[ -f /sys/class/dmi/id/product_name ]]

	2021-12-31T11:40:58.680728700Z  + fix_product_uuid

	2021-12-31T11:40:58.680732300Z  + [[ ! -f /kind/product_uuid ]]

	2021-12-31T11:40:58.680735900Z  + cat /proc/sys/kernel/random/uuid

	2021-12-31T11:40:58.683342000Z  + [[ -f /sys/class/dmi/id/product_uuid ]]

	2021-12-31T11:40:58.683365600Z  + [[ -f /sys/devices/virtual/dmi/id/product_uuid ]]

	2021-12-31T11:40:58.683375500Z  + select_iptables

	2021-12-31T11:40:58.683382400Z  + local mode=nft

	2021-12-31T11:40:58.685658400Z  ++ grep '^-'

	2021-12-31T11:40:58.685675600Z  ++ wc -l

	2021-12-31T11:40:58.817980000Z  + num_legacy_lines=6

	2021-12-31T11:40:58.818015800Z  + '[' 6 -ge 10 ']'

	2021-12-31T11:40:58.824617600Z  ++ grep '^-'

	2021-12-31T11:40:58.824709900Z  ++ wc -l

	2021-12-31T11:40:58.837439000Z  ++ true

	2021-12-31T11:40:58.837466400Z  + num_nft_lines=0

	2021-12-31T11:40:58.837491200Z  + '[' 6 -ge 0 ']'

	2021-12-31T11:40:58.837497500Z  + mode=legacy

	2021-12-31T11:40:58.837503700Z  + echo 'INFO: setting iptables to detected mode: legacy'

	2021-12-31T11:40:58.838498800Z  INFO: setting iptables to detected mode: legacy

	2021-12-31T11:40:58.838522600Z  + update-alternatives --set iptables /usr/sbin/iptables-legacy

	2021-12-31T11:40:58.839325200Z  + echo 'retryable update-alternatives: --set iptables /usr/sbin/iptables-legacy'

	2021-12-31T11:40:58.839343700Z  + local 'args=--set iptables /usr/sbin/iptables-legacy'

	2021-12-31T11:40:58.840542000Z  ++ seq 0 15

	2021-12-31T11:40:58.841719900Z  + for i in $(seq 0 15)

	2021-12-31T11:40:58.841737300Z  + /usr/bin/update-alternatives --set iptables /usr/sbin/iptables-legacy

	2021-12-31T11:40:58.855069600Z  + return

	2021-12-31T11:40:58.855089900Z  + update-alternatives --set ip6tables /usr/sbin/ip6tables-legacy

	2021-12-31T11:40:58.855095000Z  + echo 'retryable update-alternatives: --set ip6tables /usr/sbin/ip6tables-legacy'

	2021-12-31T11:40:58.855099100Z  + local 'args=--set ip6tables /usr/sbin/ip6tables-legacy'

	2021-12-31T11:40:58.856447100Z  ++ seq 0 15

	2021-12-31T11:40:58.857898300Z  + for i in $(seq 0 15)

	2021-12-31T11:40:58.857915700Z  + /usr/bin/update-alternatives --set ip6tables /usr/sbin/ip6tables-legacy

	2021-12-31T11:40:58.870754100Z  + return

	2021-12-31T11:40:58.870775400Z  + enable_network_magic

	2021-12-31T11:40:58.870780400Z  + local docker_embedded_dns_ip=127.0.0.11

	2021-12-31T11:40:58.870784100Z  + local docker_host_ip

	2021-12-31T11:40:58.873277500Z  ++ cut '-d ' -f1

	2021-12-31T11:40:58.873320700Z  ++ head -n1 /dev/fd/63

	2021-12-31T11:40:58.873333300Z  +++ getent ahostsv4 host.docker.internal

	2021-12-31T11:40:58.884899600Z  + docker_host_ip=192.168.65.2

	2021-12-31T11:40:58.885000300Z  + [[ -z 192.168.65.2 ]]

	2021-12-31T11:40:58.885012000Z  + [[ 192.168.65.2 =~ ^127\.[0-9]+\.[0-9]+\.[0-9]+$ ]]

	2021-12-31T11:40:58.885992700Z  + iptables-save

	2021-12-31T11:40:58.887395000Z  + iptables-restore

	2021-12-31T11:40:58.888966400Z  + sed -e 's/-d 127.0.0.11/-d 192.168.65.2/g' -e 's/-A OUTPUT \(.*\) -j DOCKER_OUTPUT/\0\n-A PREROUTING \1 -j DOCKER_OUTPUT/' -e 's/--to-source :53/--to-source 192.168.65.2:53/g'

	2021-12-31T11:40:59.002092600Z  + cp /etc/resolv.conf /etc/resolv.conf.original

	2021-12-31T11:40:59.005672700Z  + sed -e s/127.0.0.11/192.168.65.2/g /etc/resolv.conf.original

	2021-12-31T11:40:59.018559200Z  ++ cut '-d ' -f1

	2021-12-31T11:40:59.018584100Z  ++ head -n1 /dev/fd/63

	2021-12-31T11:40:59.018592500Z  ++++ hostname

	2021-12-31T11:40:59.021526800Z  +++ getent ahostsv4 default-k8s-different-port-20211231113947-1576

	2021-12-31T11:40:59.028367000Z  + curr_ipv4=192.168.67.2

	2021-12-31T11:40:59.028388800Z  + echo 'INFO: Detected IPv4 address: 192.168.67.2'

	2021-12-31T11:40:59.028397400Z  INFO: Detected IPv4 address: 192.168.67.2

	2021-12-31T11:40:59.028403300Z  + '[' -f /kind/old-ipv4 ']'

	2021-12-31T11:40:59.028408900Z  + [[ -n 192.168.67.2 ]]

	2021-12-31T11:40:59.028414400Z  + echo -n 192.168.67.2

	2021-12-31T11:40:59.034387600Z  ++ head -n1 /dev/fd/63

	2021-12-31T11:40:59.034503100Z  ++ cut '-d ' -f1

	2021-12-31T11:40:59.034516300Z  ++++ hostname

	2021-12-31T11:40:59.036858600Z  +++ getent ahostsv6 default-k8s-different-port-20211231113947-1576

	2021-12-31T11:40:59.040250900Z  + curr_ipv6=

	2021-12-31T11:40:59.040275600Z  + echo 'INFO: Detected IPv6 address: '

	2021-12-31T11:40:59.040300800Z  INFO: Detected IPv6 address: 

	2021-12-31T11:40:59.040309100Z  + '[' -f /kind/old-ipv6 ']'

	2021-12-31T11:40:59.040315000Z  + [[ -n '' ]]

	2021-12-31T11:40:59.041616600Z  ++ uname -a

	2021-12-31T11:40:59.043132900Z  + echo 'entrypoint completed: Linux default-k8s-different-port-20211231113947-1576 5.10.16.3-microsoft-standard-WSL2 #1 SMP Fri Apr 2 22:23:49 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux'

	2021-12-31T11:40:59.043150500Z  entrypoint completed: Linux default-k8s-different-port-20211231113947-1576 5.10.16.3-microsoft-standard-WSL2 #1 SMP Fri Apr 2 22:23:49 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

	2021-12-31T11:40:59.043155600Z  + exec /sbin/init

	2021-12-31T11:40:59.053486100Z  systemd 245.4-4ubuntu3.13 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid)

	2021-12-31T11:40:59.053509800Z  Detected virtualization wsl.

	2021-12-31T11:40:59.053518200Z  Detected architecture x86-64.

	2021-12-31T11:40:59.057619500Z  Failed to create symlink /sys/fs/cgroup/net_cls: File exists

	2021-12-31T11:40:59.057637900Z  Failed to create symlink /sys/fs/cgroup/net_prio: File exists

	2021-12-31T11:40:59.057643100Z  Failed to create symlink /sys/fs/cgroup/cpuacct: File exists

	2021-12-31T11:40:59.057647100Z  Failed to create symlink /sys/fs/cgroup/cpu: File exists

	2021-12-31T11:40:59.058668200Z  

	2021-12-31T11:40:59.058702300Z  Welcome to Ubuntu 20.04.2 LTS!

	2021-12-31T11:40:59.058728700Z  

	2021-12-31T11:40:59.058734500Z  Set hostname to <default-k8s-different-port-20211231113947-1576>.

	2021-12-31T11:40:59.128967500Z  [  OK  ] Started Dispatch Password …ts to Console Directory Watch.

	2021-12-31T11:40:59.129020700Z  [  OK  ] Set up automount Arbitrary…s File System Automount Point.

	2021-12-31T11:40:59.130031900Z  [  OK  ] Reached target Local Encrypted Volumes.

	2021-12-31T11:40:59.130054300Z  [  OK  ] Reached target Network is Online.

	2021-12-31T11:40:59.130061200Z  [  OK  ] Reached target Paths.

	2021-12-31T11:40:59.130142100Z  [  OK  ] Reached target Slices.

	2021-12-31T11:40:59.130150100Z  [  OK  ] Reached target Swap.

	2021-12-31T11:40:59.131393200Z  [  OK  ] Listening on Journal Socket (/dev/log).

	2021-12-31T11:40:59.131419500Z  [  OK  ] Listening on Journal Socket.

	2021-12-31T11:40:59.136926500Z           Mounting Huge Pages File System...

	2021-12-31T11:40:59.140334200Z           Mounting Kernel Debug File System...

	2021-12-31T11:40:59.143890700Z           Mounting Kernel Trace File System...

	2021-12-31T11:40:59.150312900Z           Starting Journal Service...

	2021-12-31T11:40:59.154301000Z           Mounting FUSE Control File System...

	2021-12-31T11:40:59.157447300Z           Starting Remount Root and Kernel File Systems...

	2021-12-31T11:40:59.161305700Z           Starting Apply Kernel Variables...

	2021-12-31T11:40:59.164313400Z  [  OK  ] Mounted Huge Pages File System.

	2021-12-31T11:40:59.164335900Z  [  OK  ] Mounted Kernel Debug File System.

	2021-12-31T11:40:59.165288100Z  [  OK  ] Mounted Kernel Trace File System.

	2021-12-31T11:40:59.165312400Z  [  OK  ] Mounted FUSE Control File System.

	2021-12-31T11:40:59.168069600Z  [  OK  ] Finished Remount Root and Kernel File Systems.

	2021-12-31T11:40:59.171161100Z           Starting Create System Users...

	2021-12-31T11:40:59.173245900Z           Starting Update UTMP about System Boot/Shutdown...

	2021-12-31T11:40:59.175156400Z  [  OK  ] Finished Apply Kernel Variables.

	2021-12-31T11:40:59.189316100Z  [  OK  ] Finished Update UTMP about System Boot/Shutdown.

	2021-12-31T11:40:59.205049800Z  [  OK  ] Started Journal Service.

	2021-12-31T11:40:59.213946300Z           Starting Flush Journal to Persistent Storage...

	2021-12-31T11:40:59.225033900Z  [  OK  ] Finished Flush Journal to Persistent Storage.

	2021-12-31T11:40:59.293153500Z  [  OK  ] Finished Create System Users.

	2021-12-31T11:40:59.295274800Z           Starting Create Static Device Nodes in /dev...

	2021-12-31T11:40:59.304261500Z  [  OK  ] Finished Create Static Device Nodes in /dev.

	2021-12-31T11:40:59.304866500Z  [  OK  ] Reached target Local File Systems (Pre).

	2021-12-31T11:40:59.304890700Z  [  OK  ] Reached target Local File Systems.

	2021-12-31T11:40:59.305524100Z  [  OK  ] Reached target System Initialization.

	2021-12-31T11:40:59.305548300Z  [  OK  ] Started Daily Cleanup of Temporary Directories.

	2021-12-31T11:40:59.305557000Z  [  OK  ] Reached target Timers.

	2021-12-31T11:40:59.306389400Z  [  OK  ] Listening on BuildKit.

	2021-12-31T11:40:59.306429300Z  [  OK  ] Listening on D-Bus System Message Bus Socket.

	2021-12-31T11:40:59.308566600Z           Starting Docker Socket for the API.

	2021-12-31T11:40:59.310732800Z           Starting Podman API Socket.

	2021-12-31T11:40:59.311599700Z  [  OK  ] Listening on Docker Socket for the API.

	2021-12-31T11:40:59.312792700Z  [  OK  ] Listening on Podman API Socket.

	2021-12-31T11:40:59.313564900Z  [  OK  ] Reached target Sockets.

	2021-12-31T11:40:59.314804800Z  [  OK  ] Reached target Basic System.

	2021-12-31T11:40:59.317214300Z           Starting containerd container runtime...

	2021-12-31T11:40:59.321862400Z  [  OK  ] Started D-Bus System Message Bus.

	2021-12-31T11:40:59.327576800Z           Starting minikube automount...

	2021-12-31T11:40:59.331173700Z           Starting OpenBSD Secure Shell server...

	2021-12-31T11:40:59.363570500Z  [  OK  ] Finished minikube automount.

	2021-12-31T11:40:59.368856100Z  [  OK  ] Started OpenBSD Secure Shell server.

	2021-12-31T11:40:59.516794800Z  [  OK  ] Started containerd container runtime.

	2021-12-31T11:40:59.523444800Z           Starting Docker Application Container Engine...

	2021-12-31T11:41:01.702561000Z  [*     ] A start job is running for Docker A…n Container Engine (2s / no limit)

	2021-12-31T11:41:02.201845000Z  M
[**    ] A start job is running for Docker A…n Container Engine (3s / no limit)

	2021-12-31T11:41:02.649643500Z  M
[  OK  ] Started Docker Application Container Engine.

	2021-12-31T11:41:02.649856900Z  [  OK  ] Reached target Multi-User System.

	2021-12-31T11:41:02.649874800Z  [  OK  ] Reached target Graphical Interface.

	2021-12-31T11:41:02.653974800Z           Starting Update UTMP about System Runlevel Changes...

	2021-12-31T11:41:02.678892500Z  [  OK  ] Finished Update UTMP about System Runlevel Changes.

	2021-12-31T11:43:23.058076200Z  [  OK  ] Stopped target Graphical Interface.

	2021-12-31T11:43:23.058336300Z  [  OK  ] Stopped target Multi-User System.

	2021-12-31T11:43:23.059140800Z  [  OK  ] Stopped target Timers.

	2021-12-31T11:43:23.059764700Z  [  OK  ] Stopped Daily Cleanup of Temporary Directories.

	2021-12-31T11:43:23.066365600Z           Stopping D-Bus System Message Bus...

	2021-12-31T11:43:23.068751700Z           Stopping Docker Application Container Engine...

	2021-12-31T11:43:23.069550500Z           Stopping kubelet: The Kubernetes Node Agent...

	2021-12-31T11:43:23.071127600Z           Stopping OpenBSD Secure Shell server...

	2021-12-31T11:43:23.075100600Z  [  OK  ] Stopped OpenBSD Secure Shell server.

	2021-12-31T11:43:23.076992200Z  [  OK  ] Stopped D-Bus System Message Bus.

	2021-12-31T11:43:23.316317700Z  [  OK  ] Stopped kubelet: The Kubernetes Node Agent.

	2021-12-31T11:43:23.920716700Z  [  OK  ] Unmounted /var/lib/docker/…33646176739269750804d3/merged.

	2021-12-31T11:43:24.017076900Z  [  OK  ] Unmounted /var/lib/docker/…0fe15fff201500abfcc048/merged.

	2021-12-31T11:43:24.157661600Z  [  OK  ] Unmounted /var/lib/docker/…08ee38a355f8ef5cb00c43/merged.

	2021-12-31T11:43:24.279570800Z  [  OK  ] Unmounted /var/lib/docker/…223326a1348aff9f7e374f/merged.

	2021-12-31T11:43:24.281535000Z  [  OK  ] Unmounted /var/lib/docker/…600ce92c551d77b7b6/mounts/shm.

	2021-12-31T11:43:24.283316400Z  [  OK  ] Unmounted /var/lib/docker/…a1cb49c753bca701ee75c2/merged.

	2021-12-31T11:43:24.357676600Z  [  OK  ] Unmounted /var/lib/docker/…ef875aaaa878998aee/mounts/shm.

	2021-12-31T11:43:24.359050800Z  [  OK  ] Unmounted /var/lib/docker/…0027f8abc57b3f73dbc3e6/merged.

	2021-12-31T11:43:24.402749200Z  [  OK  ] Unmounted /var/lib/docker/…8cfb7c9f73a861b3ce/mounts/shm.

	2021-12-31T11:43:24.404576400Z  [  OK  ] Unmounted /var/lib/docker/…ebb03e4c5d84316247fcc7/merged.

	2021-12-31T11:43:24.408549800Z  [  OK  ] Unmounted /var/lib/docker/…de0001bb6c76c49163/mounts/shm.

	2021-12-31T11:43:24.410479300Z  [  OK  ] Unmounted /var/lib/docker/…bd0177921301203963709f/merged.

	2021-12-31T11:43:24.432839800Z  [  OK  ] Unmounted /var/lib/docker/…2ee14e381438783bb8/mounts/shm.

	2021-12-31T11:43:24.434265700Z  [  OK  ] Unmounted /var/lib/docker/…25a87613716c7c81e97e63/merged.

	2021-12-31T11:43:24.442771900Z  [  OK  ] Unmounted /var/lib/docker/…dac36e08d88b63c2ae/mounts/shm.

	2021-12-31T11:43:24.442802100Z  [  OK  ] Unmounted /var/lib/docker/…bb5a64fadbe93f5de1d4e4/merged.

	2021-12-31T11:43:25.128503600Z  [  OK  ] Unmounted /run/docker/netns/08dbd9f9e457.

	2021-12-31T11:43:25.136038500Z  [  OK  ] Unmounted /var/lib/docker/…4676f27800f0dc8043/mounts/shm.

	2021-12-31T11:43:25.136095700Z  [  OK  ] Unmounted /var/lib/docker/…d3280b1d8dd91d80946ec5/merged.

	2021-12-31T11:43:25.359706400Z  [  OK  ] Unmounted /run/docker/netns/4b11d162ab34.

	2021-12-31T11:43:25.369092900Z  [  OK  ] Unmounted /var/lib/docker/…fddc2f870d53d3f9a4/mounts/shm.

	2021-12-31T11:43:25.369368000Z  [  OK  ] Unmounted /var/lib/docker/…e5157c4555b3aaf137ab8d/merged.

	2021-12-31T11:43:25.556390500Z  [  OK  ] Unmounted /run/docker/netns/9de6c3cdac26.

	2021-12-31T11:43:25.565728400Z  [  OK  ] Unmounted /var/lib/docker/…58862b686a9087cf23/mounts/shm.

	2021-12-31T11:43:25.565893700Z  [  OK  ] Unmounted /var/lib/docker/…04f175733206115914afae/merged.

	2021-12-31T11:43:27.702102000Z  [   ***] A stop job is running for Docker Ap…n Container Engine (4s / 1min 30s)

	2021-12-31T11:43:28.201971700Z  M
[    **] A stop job is running for Docker Ap…n Container Engine (5s / 1min 30s)

	2021-12-31T11:43:28.702099300Z  M
[     *] A stop job is running for Docker Ap…n Container Engine (5s / 1min 30s)

	2021-12-31T11:43:28.719573700Z  M
[  OK  ] Unmounted /var/lib/docker/…9802e6d3d034a1e147865b/merged.

	2021-12-31T11:43:32.702122200Z  [    **] A stop job is running for Docker Ap…n Container Engine (9s / 1min 30s)

	2021-12-31T11:43:33.202113800Z  M
[   ***] A stop job is running for Docker Ap… Container Engine (10s / 1min 30s)

	2021-12-31T11:43:33.414863300Z  M
[  OK  ] Unmounted /var/lib/docker/…870680a43106a8ee8f4d6a/merged.

	2021-12-31T11:43:33.686396800Z  [  OK  ] Unmounted /var/lib/docker/…0a4bc36d33f6cb89d9cf5e/merged.

	2021-12-31T11:43:33.835685800Z  [  OK  ] Unmounted /var/lib/docker/…5f26f0e1cbcbc2585f5598/merged.

	2021-12-31T11:43:33.977055700Z  [  OK  ] Stopped Docker Application Container Engine.

	2021-12-31T11:43:33.978352100Z  [  OK  ] Stopped target Network is Online.

	2021-12-31T11:43:33.979706400Z           Stopping containerd container runtime...

	2021-12-31T11:43:33.985723100Z  [  OK  ] Stopped minikube automount.

	2021-12-31T11:43:33.994121700Z  [  OK  ] Stopped containerd container runtime.

	2021-12-31T11:43:33.995101900Z  [  OK  ] Stopped target Basic System.

	2021-12-31T11:43:33.995118100Z  [  OK  ] Stopped target Paths.

	2021-12-31T11:43:33.995900200Z  [  OK  ] Stopped target Slices.

	2021-12-31T11:43:33.995917600Z  [  OK  ] Stopped target Sockets.

	2021-12-31T11:43:33.998440800Z  [  OK  ] Closed BuildKit.

	2021-12-31T11:43:34.000958100Z  [  OK  ] Closed D-Bus System Message Bus Socket.

	2021-12-31T11:43:34.003244100Z  [  OK  ] Closed Docker Socket for the API.

	2021-12-31T11:43:34.006101300Z  [  OK  ] Closed Podman API Socket.

	2021-12-31T11:43:34.006119800Z  [  OK  ] Stopped target System Initialization.

	2021-12-31T11:43:34.007076100Z  [  OK  ] Stopped target Local Encrypted Volumes.

	2021-12-31T11:43:34.052341200Z  [  OK  ] Stopped Dispatch Password …ts to Console Directory Watch.

	2021-12-31T11:43:34.052449100Z  [  OK  ] Stopped target Local File Systems.

	2021-12-31T11:43:34.054451700Z           Unmounting /data...

	2021-12-31T11:43:34.056722300Z           Unmounting /etc/hostname...

	2021-12-31T11:43:34.058591300Z           Unmounting /etc/hosts...

	2021-12-31T11:43:34.061052300Z           Unmounting /etc/resolv.conf...

	2021-12-31T11:43:34.069148100Z           Unmounting /run/docker/netns/default...

	2021-12-31T11:43:34.073321700Z           Unmounting /tmp/hostpath-provisioner...

	2021-12-31T11:43:34.075218900Z           Unmounting /tmp/hostpath_pv...

	2021-12-31T11:43:34.077516100Z           Unmounting /usr/lib/modules...

	2021-12-31T11:43:34.081160300Z           Unmounting /var/lib/kubele…ected/kube-api-access-dqbp9...

	2021-12-31T11:43:34.084501700Z           Unmounting /var/lib/kubele…ected/kube-api-access-r4gfc...

	2021-12-31T11:43:34.087474400Z           Unmounting /var/lib/kubele…ected/kube-api-access-d62t8...

	2021-12-31T11:43:34.090753700Z           Unmounting /var/lib/kubele…ected/kube-api-access-4p6kj...

	2021-12-31T11:43:34.093690000Z           Unmounting /var/lib/kubele…ected/kube-api-access-74kcm...

	2021-12-31T11:43:34.096186800Z  [  OK  ] Stopped Apply Kernel Variables.

	2021-12-31T11:43:34.097538400Z           Stopping Update UTMP about System Boot/Shutdown...

	2021-12-31T11:43:34.104650800Z  [  OK  ] Unmounted /data.

	2021-12-31T11:43:34.106595700Z  [  OK  ] Unmounted /etc/hostname.

	2021-12-31T11:43:34.109079900Z  [  OK  ] Unmounted /etc/hosts.

	2021-12-31T11:43:34.111632600Z  [  OK  ] Unmounted /etc/resolv.conf.

	2021-12-31T11:43:34.113497200Z  [  OK  ] Unmounted /run/docker/netns/default.

	2021-12-31T11:43:34.115548000Z  [  OK  ] Unmounted /tmp/hostpath-provisioner.

	2021-12-31T11:43:34.118148700Z  [  OK  ] Unmounted /tmp/hostpath_pv.

	2021-12-31T11:43:34.120487100Z  [  OK  ] Unmounted /usr/lib/modules.

	2021-12-31T11:43:34.122850000Z  [  OK  ] Unmounted /var/lib/kubelet…ojected/kube-api-access-dqbp9.

	2021-12-31T11:43:34.125378700Z  [  OK  ] Unmounted /var/lib/kubelet…ojected/kube-api-access-r4gfc.

	2021-12-31T11:43:34.128410700Z  [  OK  ] Unmounted /var/lib/kubelet…ojected/kube-api-access-d62t8.

	2021-12-31T11:43:34.130991800Z  [  OK  ] Unmounted /var/lib/kubelet…ojected/kube-api-access-4p6kj.

	2021-12-31T11:43:34.133301500Z  [  OK  ] Unmounted /var/lib/kubelet…ojected/kube-api-access-74kcm.

	2021-12-31T11:43:34.137880600Z           Unmounting /tmp...

	2021-12-31T11:43:34.141183100Z  [  OK  ] Stopped Update UTMP about System Boot/Shutdown.

	2021-12-31T11:43:34.147061800Z  [  OK  ] Unmounted /tmp.

	2021-12-31T11:43:34.148152100Z  [  OK  ] Stopped target Swap.

	2021-12-31T11:43:34.149541600Z           Unmounting /var...

	2021-12-31T11:43:34.157733500Z  [  OK  ] Unmounted /var.

	2021-12-31T11:43:34.158450800Z  [  OK  ] Stopped target Local File Systems (Pre).

	2021-12-31T11:43:34.158475700Z  [  OK  ] Reached target Unmount All Filesystems.

	2021-12-31T11:43:34.162545100Z  [  OK  ] Stopped Create Static Device Nodes in /dev.

	2021-12-31T11:43:34.165622800Z  [  OK  ] Stopped Create System Users.

	2021-12-31T11:43:34.168344500Z  [  OK  ] Stopped Remount Root and Kernel File Systems.

	2021-12-31T11:43:34.168365700Z  [  OK  ] Reached target Shutdown.

	2021-12-31T11:43:34.168984400Z  [  OK  ] Reached target Final Step.

	2021-12-31T11:43:34.170366700Z  [  OK  ] Finished Power-Off.

	2021-12-31T11:43:34.170400000Z  [  OK  ] Reached target Power-Off.

	-- /stdout --

	I1231 11:44:06.814286   10808 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:44:09.165944   10808 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.3516477s)

	I1231 11:44:09.165944   10808 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:59 OomKillDisable:true NGoroutines:50 SystemTime:2021-12-31 11:44:08.0663063 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_

bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:44:09.165944   10808 errors.go:98] postmortem docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:59 OomKillDisable:true NGoroutines:50 SystemTime:2021-12-31 11:44:08.0663063 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Archit

ecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio th

rottle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:44:09.173443   10808 network_create.go:254] running [docker network inspect default-k8s-different-port-20211231113947-1576] to gather additional debugging logs...

	I1231 11:44:09.173579   10808 cli_runner.go:133] Run: docker network inspect default-k8s-different-port-20211231113947-1576

	W1231 11:44:10.555090   10808 cli_runner.go:180] docker network inspect default-k8s-different-port-20211231113947-1576 returned with exit code 1

	I1231 11:44:10.555090   10808 cli_runner.go:186] Completed: docker network inspect default-k8s-different-port-20211231113947-1576: (1.3815051s)

	I1231 11:44:10.555090   10808 network_create.go:257] error running [docker network inspect default-k8s-different-port-20211231113947-1576]: docker network inspect default-k8s-different-port-20211231113947-1576: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: default-k8s-different-port-20211231113947-1576

	I1231 11:44:10.555090   10808 network_create.go:259] output of [docker network inspect default-k8s-different-port-20211231113947-1576]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: default-k8s-different-port-20211231113947-1576

	** /stderr **

	I1231 11:44:10.562082   10808 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:44:12.884610   10808 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.3225173s)

	I1231 11:44:12.884680   10808 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:59 OomKillDisable:true NGoroutines:50 SystemTime:2021-12-31 11:44:11.8079497 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_

bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:44:12.893743   10808 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20211231113947-1576

	I1231 11:44:14.253628   10808 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20211231113947-1576: (1.3594798s)

	I1231 11:44:14.253712   10808 profile.go:147] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\default-k8s-different-port-20211231113947-1576\config.json ...

	I1231 11:44:14.257314   10808 machine.go:88] provisioning docker machine ...

	I1231 11:44:14.257426   10808 ubuntu.go:169] provisioning hostname "default-k8s-different-port-20211231113947-1576"

	I1231 11:44:14.268370   10808 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576

	W1231 11:44:15.625496   10808 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576 returned with exit code 1

	I1231 11:44:15.625496   10808 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576: (1.3571198s)

	I1231 11:44:15.625496   10808 machine.go:91] provisioned docker machine in 1.3681758s

	I1231 11:44:15.634514   10808 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1231 11:44:15.641480   10808 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576

	W1231 11:44:17.012129   10808 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576 returned with exit code 1

	I1231 11:44:17.012129   10808 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576: (1.3706432s)

	I1231 11:44:17.012129   10808 retry.go:31] will retry after 276.165072ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I1231 11:44:17.295006   10808 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576

	W1231 11:44:18.702517   10808 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576 returned with exit code 1

	I1231 11:44:18.702597   10808 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576: (1.4073972s)

	W1231 11:44:18.702916   10808 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W1231 11:44:18.703010   10808 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I1231 11:44:18.703010   10808 fix.go:57] fixHost completed within 22.5935964s

	I1231 11:44:18.703058   10808 start.go:80] releasing machines lock for "default-k8s-different-port-20211231113947-1576", held for 22.5938091s

	W1231 11:44:18.703370   10808 start.go:566] error starting host: provision: get ssh host-port: unable to inspect a not running container to get SSH port

	W1231 11:44:18.703597   10808 out.go:241] ! StartHost failed, but will try again: provision: get ssh host-port: unable to inspect a not running container to get SSH port

	! StartHost failed, but will try again: provision: get ssh host-port: unable to inspect a not running container to get SSH port

	I1231 11:44:18.703597   10808 start.go:581] Will try again in 5 seconds ...

	I1231 11:44:23.704752   10808 start.go:313] acquiring machines lock for default-k8s-different-port-20211231113947-1576: {Name:mk17edddb79115da08708c92c50bc6cb1ee15fb6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1231 11:44:23.704752   10808 start.go:317] acquired machines lock for "default-k8s-different-port-20211231113947-1576" in 0s

	I1231 11:44:23.704752   10808 start.go:93] Skipping create...Using existing machine configuration

	I1231 11:44:23.704752   10808 fix.go:55] fixHost starting: 

	I1231 11:44:23.716483   10808 cli_runner.go:133] Run: docker container inspect default-k8s-different-port-20211231113947-1576 --format={{.State.Status}}

	I1231 11:44:25.076518   10808 cli_runner.go:186] Completed: docker container inspect default-k8s-different-port-20211231113947-1576 --format={{.State.Status}}: (1.3600286s)

	I1231 11:44:25.076518   10808 fix.go:108] recreateIfNeeded on default-k8s-different-port-20211231113947-1576: state=Stopped err=<nil>

	W1231 11:44:25.076518   10808 fix.go:134] unexpected machine state, will restart: <nil>

	I1231 11:44:25.082492   10808 out.go:176] * Restarting existing docker container for "default-k8s-different-port-20211231113947-1576" ...

	I1231 11:44:25.089497   10808 cli_runner.go:133] Run: docker start default-k8s-different-port-20211231113947-1576

	W1231 11:44:27.367643   10808 cli_runner.go:180] docker start default-k8s-different-port-20211231113947-1576 returned with exit code 1

	I1231 11:44:27.367734   10808 cli_runner.go:186] Completed: docker start default-k8s-different-port-20211231113947-1576: (2.2781366s)

	I1231 11:44:27.373475   10808 cli_runner.go:133] Run: docker inspect default-k8s-different-port-20211231113947-1576

	I1231 11:44:28.679054   10808 cli_runner.go:186] Completed: docker inspect default-k8s-different-port-20211231113947-1576: (1.3045661s)

	I1231 11:44:28.679054   10808 errors.go:84] Postmortem inspect ("docker inspect default-k8s-different-port-20211231113947-1576"): -- stdout --

	[

	    {

	        "Id": "11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106",

	        "Created": "2021-12-31T11:40:54.5144635Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "exited",

	            "Running": false,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 0,

	            "ExitCode": 130,

	            "Error": "network 28f2b467e2029f6c69bcf00096c983d688568193b5931ffd81919f4d2577d2d5 not found",

	            "StartedAt": "2021-12-31T11:40:58.2322175Z",

	            "FinishedAt": "2021-12-31T11:43:34.3564494Z"

	        },

	        "Image": "sha256:64d09634c60d2a75596bc705aa84bdc41f76fe47c5d9ee362550bffbdc256979",

	        "ResolvConfPath": "/var/lib/docker/containers/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106/hostname",

	        "HostsPath": "/var/lib/docker/containers/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106/hosts",

	        "LogPath": "/var/lib/docker/containers/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106-json.log",

	        "Name": "/default-k8s-different-port-20211231113947-1576",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "default-k8s-different-port-20211231113947-1576:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "default-k8s-different-port-20211231113947-1576",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8444/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2306867200,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                {

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

	                }

	            ],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 2306867200,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/360bd4e7ed2df2c7db9344ab61b1d38661276023bee06c9c05b655772766af89-init/diff:/var/lib/docker/overlay2/236e34868c6bd5ecc10a009188d3dd414c10322ed61f0f8bd2f0cc6afe31d4a2/diff:/var/lib/docker/overlay2/4f26d83e8780f057af23a45796afe2feeb4c6225d04f3e75d86d76ce33e6eeb7/diff:/var/lib/docker/overlay2/1aa2f7df6f61654ba127b3d7ca8e4c7c9faa9ea133a905aee86c5c729b50580e/diff:/var/lib/docker/overlay2/810f58a572d447e357f0e37fcb6e434743ec2c41f1a828b80ea35481ad056b01/diff:/var/lib/docker/overlay2/0f8aaf037fa7c7675cf275f7d2ec3ea76e658acf5a3dab8397689e8f0f123d26/diff:/var/lib/docker/overlay2/be7ae9f76a1638260aab5f1fa7ff3040af697c9a44380f0cc9d6b9f8e13fc3d0/diff:/var/lib/docker/overlay2/ef02c9f68049a2b4bbb3c853a879f858f696367e0e4a0cd3c8f8a560cf64f559/diff:/var/lib/docker/overlay2/35131ade500d28bbea06e314019475aaefc896faf010312fe4a992789b633265/diff:/var/lib/docker/overlay2/8d9649b172e37864a9f036c4de74b67ea5b01978cffc6a9362049d5ea5d6f55d/diff:/var/lib/docker/overlay2/52868f

77169cdf9bc78bcde8ac7ec95f1a8185a6302edb584dbf9a6360daf03a/diff:/var/lib/docker/overlay2/f8c18464f7aef662c8d4ad84d2451d43835e5f4569a4d2b9f30ad97322903d11/diff:/var/lib/docker/overlay2/0101fb0a80bf47a589e85bb95fd060770df32c7a11dbd8a7dcfef4d9d01f8af2/diff:/var/lib/docker/overlay2/07d0477dc6604496cacf7ed9c358a06fe7d29546c33411fecdaf0ecaa2a9a0ef/diff:/var/lib/docker/overlay2/3f31c6e0e5aac9e858d82dd03ebea66448458f5a927add3f654a304d2c37e502/diff:/var/lib/docker/overlay2/d7ed3b53a0a390071295a19edc1e7d6c00a99dfe061348b28a62f8b9a82318d0/diff:/var/lib/docker/overlay2/3b636a10aa41811f93fe647f4a2254548b80bdeb098c8533b22c4d79d53fcdf0/diff:/var/lib/docker/overlay2/ce837cfcf557adff25b0b4b5f4d6f01e0cf5a1b8bb23ee431d224975cacbe2b0/diff:/var/lib/docker/overlay2/3605fc7a2584009be0a2860c72bef0b598b9bc1f266a398074b7c8a7123333b1/diff:/var/lib/docker/overlay2/05a27701432d46329015577bf385d007c4190625712f8101bb39d9a5744fae1b/diff:/var/lib/docker/overlay2/c25e37734ac3910f77446ef67a386f29de76d35b911b15e745ab7622def0e089/diff:/var/lib/d

ocker/overlay2/a8e782b00e5454fb7d4ededfc9896090aac72e1b0b4c00e43cc9e0bdcf4d2906/diff:/var/lib/docker/overlay2/44c82f3c0e578428d3d9bd874ec44bdd533b0d6845072a4aac19be4720565273/diff:/var/lib/docker/overlay2/14d59fa1343c7e69048f262f4f3f304832c41b33f9f6b5d17a01d67b6c488996/diff:/var/lib/docker/overlay2/15c980de9f5f13135282866b74e142b0c02c48a68d5b570fdb352734d154c43c/diff:/var/lib/docker/overlay2/82368a0688767ffd3b7eb2fd7f8cf27704e4ae4f7ecbb8b8b73f437e928c0db7/diff:/var/lib/docker/overlay2/e976758fe64d0a07d050f840cfff6da24646e500eb0758ad525eec4402c332fb/diff:/var/lib/docker/overlay2/74148e6df6795f39b3025653e1114d8d16999f340f4ace621d5d37e82a3698fe/diff:/var/lib/docker/overlay2/05e29b3eb2babc45b9101583a4b8dc9c219237c4297f0678b648a934cd2cf604/diff:/var/lib/docker/overlay2/d7cae5db557577bece8070136b11e87052bce1263acb0b687e90567746b09f61/diff:/var/lib/docker/overlay2/5b1ff4405c06a77b96c7b61fbf1df81004551144d651ae61b632dfc3b269bc76/diff:/var/lib/docker/overlay2/f50ff6635032640d426a42ecb016d73fdb96ba15505a1ae4f01d7cb3315

925fb/diff:/var/lib/docker/overlay2/72f65c380012ae92d0675a1b93218ad4ecd8addccb3371324d814fa248daed27/diff:/var/lib/docker/overlay2/b1c4ea370005cb0ea474c83801a0ba4b376d83bfe171b465e61eeab9fbd46b68/diff:/var/lib/docker/overlay2/182b2273f71a8695b8a041e54bb701488b71028091c701a3271bdf6fd0f2c5f5/diff:/var/lib/docker/overlay2/31812fd31cbde39dd1044b048c3f74540d47fbb1dd15634a350ede4f6725dea5/diff:/var/lib/docker/overlay2/58541d8dc75e6a2ece804245b92e88e76345bdbbdda996fbd757eb2290e3e609/diff:/var/lib/docker/overlay2/207a2c171a9595e78850f4fe19c5e78e337c2201f45a4cebc01f869ca7eecf54/diff:/var/lib/docker/overlay2/93569597c37885046de0762af7ba9d6379d54b5533be30cc27f514859f28f7ba/diff:/var/lib/docker/overlay2/57f04579d4692224f2cabd08068218468a37e48174920084405ce9ae88d5d7a7/diff:/var/lib/docker/overlay2/db96b3bbab3bd95dcee0936a5ab318b82dcc941cc09c1fd201e21d97dd5d7617/diff:/var/lib/docker/overlay2/0560b92e88427b3710f730d81a8d910fa8c7feee2a4273c4abb5c51364213d07/diff:/var/lib/docker/overlay2/4e3f380bd40064fcfb56a83f831a38ef53e4ea

bbf36f7661d063e55ccf2972c0/diff:/var/lib/docker/overlay2/65534d10a48ed16cb8b24cc817d40ad1c80c0bbb261a2b966fb4e1bac0f2b524/diff:/var/lib/docker/overlay2/799e74a4ab0cf4fb970c0d6f14af7e37410bf1168fcb40d81c85c773f406f235/diff",

	                "MergedDir": "/var/lib/docker/overlay2/360bd4e7ed2df2c7db9344ab61b1d38661276023bee06c9c05b655772766af89/merged",

	                "UpperDir": "/var/lib/docker/overlay2/360bd4e7ed2df2c7db9344ab61b1d38661276023bee06c9c05b655772766af89/diff",

	                "WorkDir": "/var/lib/docker/overlay2/360bd4e7ed2df2c7db9344ab61b1d38661276023bee06c9c05b655772766af89/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "default-k8s-different-port-20211231113947-1576",

	                "Source": "/var/lib/docker/volumes/default-k8s-different-port-20211231113947-1576/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "default-k8s-different-port-20211231113947-1576",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8444/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "default-k8s-different-port-20211231113947-1576",

	                "name.minikube.sigs.k8s.io": "default-k8s-different-port-20211231113947-1576",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "aaf3b09ad27e886c553df33c0beee25d2ce62859bd45339fbcf09556183a5f3a",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {},

	            "SandboxKey": "/var/run/docker/netns/aaf3b09ad27e",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "default-k8s-different-port-20211231113947-1576": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.67.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "11225af84302",

	                        "default-k8s-different-port-20211231113947-1576"

	                    ],

	                    "NetworkID": "28f2b467e2029f6c69bcf00096c983d688568193b5931ffd81919f4d2577d2d5",

	                    "EndpointID": "",

	                    "Gateway": "",

	                    "IPAddress": "",

	                    "IPPrefixLen": 0,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

	-- /stdout --

	I1231 11:44:28.685066   10808 cli_runner.go:133] Run: docker logs --timestamps --details default-k8s-different-port-20211231113947-1576

	I1231 11:44:30.047370   10808 cli_runner.go:186] Completed: docker logs --timestamps --details default-k8s-different-port-20211231113947-1576: (1.3622981s)

	I1231 11:44:30.047370   10808 errors.go:91] Postmortem logs ("docker logs --timestamps --details default-k8s-different-port-20211231113947-1576"): -- stdout --

	2021-12-31T11:40:58.230178100Z  + userns=

	2021-12-31T11:40:58.230236200Z  + grep -Eqv '0[[:space:]]+0[[:space:]]+4294967295' /proc/self/uid_map

	2021-12-31T11:40:58.237384200Z  + validate_userns

	2021-12-31T11:40:58.237413800Z  + [[ -z '' ]]

	2021-12-31T11:40:58.237433200Z  + return

	2021-12-31T11:40:58.237440800Z  + configure_containerd

	2021-12-31T11:40:58.239334400Z  ++ stat -f -c %T /kind

	2021-12-31T11:40:58.246035300Z  + [[ overlayfs == \z\f\s ]]

	2021-12-31T11:40:58.246063600Z  + configure_proxy

	2021-12-31T11:40:58.246074500Z  + mkdir -p /etc/systemd/system.conf.d/

	2021-12-31T11:40:58.250624400Z  + [[ ! -z '' ]]

	2021-12-31T11:40:58.250650500Z  + cat

	2021-12-31T11:40:58.253663000Z  + fix_kmsg

	2021-12-31T11:40:58.253956400Z  + [[ ! -e /dev/kmsg ]]

	2021-12-31T11:40:58.253975500Z  + fix_mount

	2021-12-31T11:40:58.253983200Z  + echo 'INFO: ensuring we can execute mount/umount even with userns-remap'

	2021-12-31T11:40:58.253989200Z  INFO: ensuring we can execute mount/umount even with userns-remap

	2021-12-31T11:40:58.253995100Z  ++ which mount

	2021-12-31T11:40:58.256893700Z  ++ which umount

	2021-12-31T11:40:58.258891600Z  + chown root:root /usr/bin/mount /usr/bin/umount

	2021-12-31T11:40:58.350980700Z  ++ which mount

	2021-12-31T11:40:58.353302200Z  ++ which umount

	2021-12-31T11:40:58.354949900Z  + chmod -s /usr/bin/mount /usr/bin/umount

	2021-12-31T11:40:58.358145500Z  +++ which mount

	2021-12-31T11:40:58.359710900Z  ++ stat -f -c %T /usr/bin/mount

	2021-12-31T11:40:58.361789200Z  + [[ overlayfs == \a\u\f\s ]]

	2021-12-31T11:40:58.361889500Z  + [[ -z '' ]]

	2021-12-31T11:40:58.361902000Z  + echo 'INFO: remounting /sys read-only'

	2021-12-31T11:40:58.361908300Z  INFO: remounting /sys read-only

	2021-12-31T11:40:58.361914300Z  + mount -o remount,ro /sys

	2021-12-31T11:40:58.365039800Z  + echo 'INFO: making mounts shared'

	2021-12-31T11:40:58.365056600Z  INFO: making mounts shared

	2021-12-31T11:40:58.365061100Z  + mount --make-rshared /

	2021-12-31T11:40:58.367254800Z  + retryable_fix_cgroup

	2021-12-31T11:40:58.367833300Z  ++ seq 0 10

	2021-12-31T11:40:58.369227300Z  + for i in $(seq 0 10)

	2021-12-31T11:40:58.369249700Z  + fix_cgroup

	2021-12-31T11:40:58.369254100Z  + [[ -f /sys/fs/cgroup/cgroup.controllers ]]

	2021-12-31T11:40:58.369257900Z  + echo 'INFO: detected cgroup v1'

	2021-12-31T11:40:58.369261500Z  INFO: detected cgroup v1

	2021-12-31T11:40:58.369264900Z  + echo 'INFO: fix cgroup mounts for all subsystems'

	2021-12-31T11:40:58.369268600Z  INFO: fix cgroup mounts for all subsystems

	2021-12-31T11:40:58.369285700Z  + local current_cgroup

	2021-12-31T11:40:58.371127300Z  ++ grep -E '^[^:]*:([^:]*,)?cpu(,[^,:]*)?:.*' /proc/self/cgroup

	2021-12-31T11:40:58.371152200Z  ++ cut -d: -f3

	2021-12-31T11:40:58.373304800Z  + current_cgroup=/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.373322900Z  + local cgroup_subsystems

	2021-12-31T11:40:58.374775900Z  ++ findmnt -lun -o source,target -t cgroup

	2021-12-31T11:40:58.374797300Z  ++ grep /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.374890600Z  ++ awk '{print $2}'

	2021-12-31T11:40:58.378796600Z  + cgroup_subsystems='/sys/fs/cgroup/cpuset

	2021-12-31T11:40:58.378882500Z  /sys/fs/cgroup/cpu

	2021-12-31T11:40:58.378896900Z  /sys/fs/cgroup/cpuacct

	2021-12-31T11:40:58.378903600Z  /sys/fs/cgroup/blkio

	2021-12-31T11:40:58.378909200Z  /sys/fs/cgroup/memory

	2021-12-31T11:40:58.378914900Z  /sys/fs/cgroup/devices

	2021-12-31T11:40:58.378920400Z  /sys/fs/cgroup/freezer

	2021-12-31T11:40:58.378925900Z  /sys/fs/cgroup/net_cls

	2021-12-31T11:40:58.378930100Z  /sys/fs/cgroup/perf_event

	2021-12-31T11:40:58.378933300Z  /sys/fs/cgroup/net_prio

	2021-12-31T11:40:58.378936500Z  /sys/fs/cgroup/hugetlb

	2021-12-31T11:40:58.378939700Z  /sys/fs/cgroup/pids

	2021-12-31T11:40:58.379022700Z  /sys/fs/cgroup/systemd'

	2021-12-31T11:40:58.379028400Z  + local cgroup_mounts

	2021-12-31T11:40:58.379588800Z  ++ grep -E -o '/[[:alnum:]].* /sys/fs/cgroup.*.*cgroup' /proc/self/mountinfo

	2021-12-31T11:40:58.382754800Z  + cgroup_mounts='/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime shared:242 master:53 - cgroup

	2021-12-31T11:40:58.382777900Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpu rw,nosuid,nodev,noexec,relatime shared:245 master:54 - cgroup

	2021-12-31T11:40:58.382785800Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpuacct rw,nosuid,nodev,noexec,relatime shared:246 master:55 - cgroup

	2021-12-31T11:40:58.382791800Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime shared:247 master:56 - cgroup

	2021-12-31T11:40:58.382798300Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime shared:248 master:57 - cgroup

	2021-12-31T11:40:58.382804200Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime shared:249 master:58 - cgroup

	2021-12-31T11:40:58.382810200Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime shared:250 master:59 - cgroup

	2021-12-31T11:40:58.382816200Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/net_cls rw,nosuid,nodev,noexec,relatime shared:251 master:60 - cgroup

	2021-12-31T11:40:58.382835800Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime shared:252 master:61 - cgroup

	2021-12-31T11:40:58.382842000Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/net_prio rw,nosuid,nodev,noexec,relatime shared:264 master:62 - cgroup

	2021-12-31T11:40:58.382845700Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/hugetlb rw,nosuid,nodev,noexec,relatime shared:265 master:63 - cgroup

	2021-12-31T11:40:58.382849100Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/pids rw,nosuid,nodev,noexec,relatime shared:266 master:64 - cgroup

	2021-12-31T11:40:58.382854100Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/systemd rw,nosuid,nodev,noexec,relatime shared:268 master:66 - cgroup cgroup'

	2021-12-31T11:40:58.382857800Z  + [[ -n /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime shared:242 master:53 - cgroup

	2021-12-31T11:40:58.382861200Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpu rw,nosuid,nodev,noexec,relatime shared:245 master:54 - cgroup

	2021-12-31T11:40:58.382864700Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpuacct rw,nosuid,nodev,noexec,relatime shared:246 master:55 - cgroup

	2021-12-31T11:40:58.382868100Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime shared:247 master:56 - cgroup

	2021-12-31T11:40:58.382871500Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime shared:248 master:57 - cgroup

	2021-12-31T11:40:58.382874900Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime shared:249 master:58 - cgroup

	2021-12-31T11:40:58.382878200Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime shared:250 master:59 - cgroup

	2021-12-31T11:40:58.382881700Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/net_cls rw,nosuid,nodev,noexec,relatime shared:251 master:60 - cgroup

	2021-12-31T11:40:58.382885200Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime shared:252 master:61 - cgroup

	2021-12-31T11:40:58.382888500Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/net_prio rw,nosuid,nodev,noexec,relatime shared:264 master:62 - cgroup

	2021-12-31T11:40:58.382891900Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/hugetlb rw,nosuid,nodev,noexec,relatime shared:265 master:63 - cgroup

	2021-12-31T11:40:58.382895300Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/pids rw,nosuid,nodev,noexec,relatime shared:266 master:64 - cgroup

	2021-12-31T11:40:58.382899100Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/systemd rw,nosuid,nodev,noexec,relatime shared:268 master:66 - cgroup cgroup ]]

	2021-12-31T11:40:58.382925900Z  + local mount_root

	2021-12-31T11:40:58.383982400Z  ++ head -n 1

	2021-12-31T11:40:58.384022000Z  ++ cut '-d ' -f1

	2021-12-31T11:40:58.386130600Z  + mount_root=/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.387755400Z  ++ echo '/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime shared:242 master:53 - cgroup

	2021-12-31T11:40:58.387777100Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpu rw,nosuid,nodev,noexec,relatime shared:245 master:54 - cgroup

	2021-12-31T11:40:58.387786000Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/cpuacct rw,nosuid,nodev,noexec,relatime shared:246 master:55 - cgroup

	2021-12-31T11:40:58.387792700Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime shared:247 master:56 - cgroup

	2021-12-31T11:40:58.387799400Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime shared:248 master:57 - cgroup

	2021-12-31T11:40:58.387805900Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime shared:249 master:58 - cgroup

	2021-12-31T11:40:58.387812400Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime shared:250 master:59 - cgroup

	2021-12-31T11:40:58.387818600Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/net_cls rw,nosuid,nodev,noexec,relatime shared:251 master:60 - cgroup

	2021-12-31T11:40:58.387825100Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime shared:252 master:61 - cgroup

	2021-12-31T11:40:58.387831500Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/net_prio rw,nosuid,nodev,noexec,relatime shared:264 master:62 - cgroup

	2021-12-31T11:40:58.387837700Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/hugetlb rw,nosuid,nodev,noexec,relatime shared:265 master:63 - cgroup

	2021-12-31T11:40:58.387843600Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/pids rw,nosuid,nodev,noexec,relatime shared:266 master:64 - cgroup

	2021-12-31T11:40:58.387851900Z  /docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106 /sys/fs/cgroup/systemd rw,nosuid,nodev,noexec,relatime shared:268 master:66 - cgroup cgroup'

	2021-12-31T11:40:58.387858700Z  ++ cut '-d ' -f 2

	2021-12-31T11:40:58.389970400Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.389993700Z  + local target=/sys/fs/cgroup/cpuset/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.390001100Z  + findmnt /sys/fs/cgroup/cpuset/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.393697000Z  + mkdir -p /sys/fs/cgroup/cpuset/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.451832900Z  + mount --bind /sys/fs/cgroup/cpuset /sys/fs/cgroup/cpuset/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.454302900Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.454323600Z  + local target=/sys/fs/cgroup/cpu/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.454332700Z  + findmnt /sys/fs/cgroup/cpu/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.457790700Z  + mkdir -p /sys/fs/cgroup/cpu/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.459841700Z  + mount --bind /sys/fs/cgroup/cpu /sys/fs/cgroup/cpu/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.462638900Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.462674600Z  + local target=/sys/fs/cgroup/cpuacct/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.462679900Z  + findmnt /sys/fs/cgroup/cpuacct/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.465594900Z  + mkdir -p /sys/fs/cgroup/cpuacct/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.467405800Z  + mount --bind /sys/fs/cgroup/cpuacct /sys/fs/cgroup/cpuacct/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.470290400Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.470314000Z  + local target=/sys/fs/cgroup/blkio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.470322400Z  + findmnt /sys/fs/cgroup/blkio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.473415000Z  + mkdir -p /sys/fs/cgroup/blkio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.475919500Z  + mount --bind /sys/fs/cgroup/blkio /sys/fs/cgroup/blkio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.478319800Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.478340800Z  + local target=/sys/fs/cgroup/memory/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.478349400Z  + findmnt /sys/fs/cgroup/memory/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.481839700Z  + mkdir -p /sys/fs/cgroup/memory/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.484986500Z  + mount --bind /sys/fs/cgroup/memory /sys/fs/cgroup/memory/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.488689800Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.488718400Z  + local target=/sys/fs/cgroup/devices/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.488751100Z  + findmnt /sys/fs/cgroup/devices/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.492095900Z  + mkdir -p /sys/fs/cgroup/devices/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.494106600Z  + mount --bind /sys/fs/cgroup/devices /sys/fs/cgroup/devices/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.496600700Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.496618300Z  + local target=/sys/fs/cgroup/freezer/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.496623500Z  + findmnt /sys/fs/cgroup/freezer/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.499486100Z  + mkdir -p /sys/fs/cgroup/freezer/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.501691500Z  + mount --bind /sys/fs/cgroup/freezer /sys/fs/cgroup/freezer/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.504126400Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.504148800Z  + local target=/sys/fs/cgroup/net_cls/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.504156900Z  + findmnt /sys/fs/cgroup/net_cls/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.507023300Z  + mkdir -p /sys/fs/cgroup/net_cls/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.508904300Z  + mount --bind /sys/fs/cgroup/net_cls /sys/fs/cgroup/net_cls/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.511018600Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.511053700Z  + local target=/sys/fs/cgroup/perf_event/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.511058500Z  + findmnt /sys/fs/cgroup/perf_event/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.515577400Z  + mkdir -p /sys/fs/cgroup/perf_event/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.517922100Z  + mount --bind /sys/fs/cgroup/perf_event /sys/fs/cgroup/perf_event/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.523537300Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.523562100Z  + local target=/sys/fs/cgroup/net_prio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.523578300Z  + findmnt /sys/fs/cgroup/net_prio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.528244400Z  + mkdir -p /sys/fs/cgroup/net_prio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.532132900Z  + mount --bind /sys/fs/cgroup/net_prio /sys/fs/cgroup/net_prio/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.535266500Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.535307100Z  + local target=/sys/fs/cgroup/hugetlb/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.535315300Z  + findmnt /sys/fs/cgroup/hugetlb/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.539488600Z  + mkdir -p /sys/fs/cgroup/hugetlb/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.542214500Z  + mount --bind /sys/fs/cgroup/hugetlb /sys/fs/cgroup/hugetlb/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.544673200Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.544689400Z  + local target=/sys/fs/cgroup/pids/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.544715600Z  + findmnt /sys/fs/cgroup/pids/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.547587800Z  + mkdir -p /sys/fs/cgroup/pids/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.549557900Z  + mount --bind /sys/fs/cgroup/pids /sys/fs/cgroup/pids/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.552378100Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2021-12-31T11:40:58.552396400Z  + local target=/sys/fs/cgroup/systemd/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.552401300Z  + findmnt /sys/fs/cgroup/systemd/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.555303900Z  + mkdir -p /sys/fs/cgroup/systemd/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.557341900Z  + mount --bind /sys/fs/cgroup/systemd /sys/fs/cgroup/systemd/docker/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106

	2021-12-31T11:40:58.559481200Z  + mount --make-rprivate /sys/fs/cgroup

	2021-12-31T11:40:58.562480800Z  + echo '/sys/fs/cgroup/cpuset

	2021-12-31T11:40:58.562504200Z  /sys/fs/cgroup/cpu

	2021-12-31T11:40:58.562511800Z  /sys/fs/cgroup/cpuacct

	2021-12-31T11:40:58.562517400Z  /sys/fs/cgroup/blkio

	2021-12-31T11:40:58.562523100Z  /sys/fs/cgroup/memory

	2021-12-31T11:40:58.562528700Z  /sys/fs/cgroup/devices

	2021-12-31T11:40:58.562534000Z  /sys/fs/cgroup/freezer

	2021-12-31T11:40:58.562539600Z  /sys/fs/cgroup/net_cls

	2021-12-31T11:40:58.562545100Z  /sys/fs/cgroup/perf_event

	2021-12-31T11:40:58.562550200Z  /sys/fs/cgroup/net_prio

	2021-12-31T11:40:58.562556500Z  /sys/fs/cgroup/hugetlb

	2021-12-31T11:40:58.562562200Z  /sys/fs/cgroup/pids

	2021-12-31T11:40:58.562567900Z  /sys/fs/cgroup/systemd'

	2021-12-31T11:40:58.562573500Z  + IFS=

	2021-12-31T11:40:58.562578900Z  + read -r subsystem

	2021-12-31T11:40:58.563354900Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/cpuset

	2021-12-31T11:40:58.563376600Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.563383400Z  + local subsystem=/sys/fs/cgroup/cpuset

	2021-12-31T11:40:58.563389500Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.563395300Z  + mkdir -p /sys/fs/cgroup/cpuset//kubelet

	2021-12-31T11:40:58.565417800Z  + '[' /sys/fs/cgroup/cpuset == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.565461000Z  + cat /sys/fs/cgroup/cpuset/cpuset.cpus

	2021-12-31T11:40:58.568573000Z  + cat /sys/fs/cgroup/cpuset/cpuset.mems

	2021-12-31T11:40:58.570314400Z  + mount --bind /sys/fs/cgroup/cpuset//kubelet /sys/fs/cgroup/cpuset//kubelet

	2021-12-31T11:40:58.573149000Z  + IFS=

	2021-12-31T11:40:58.573184600Z  + read -r subsystem

	2021-12-31T11:40:58.573189500Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/cpu

	2021-12-31T11:40:58.573193100Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.573196400Z  + local subsystem=/sys/fs/cgroup/cpu

	2021-12-31T11:40:58.573199800Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.573203200Z  + mkdir -p /sys/fs/cgroup/cpu//kubelet

	2021-12-31T11:40:58.575555000Z  + '[' /sys/fs/cgroup/cpu == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.575578300Z  + mount --bind /sys/fs/cgroup/cpu//kubelet /sys/fs/cgroup/cpu//kubelet

	2021-12-31T11:40:58.578245500Z  + IFS=

	2021-12-31T11:40:58.578264600Z  + read -r subsystem

	2021-12-31T11:40:58.578272200Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/cpuacct

	2021-12-31T11:40:58.578279200Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.578285200Z  + local subsystem=/sys/fs/cgroup/cpuacct

	2021-12-31T11:40:58.578291100Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.578296800Z  + mkdir -p /sys/fs/cgroup/cpuacct//kubelet

	2021-12-31T11:40:58.580230100Z  + '[' /sys/fs/cgroup/cpuacct == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.580249600Z  + mount --bind /sys/fs/cgroup/cpuacct//kubelet /sys/fs/cgroup/cpuacct//kubelet

	2021-12-31T11:40:58.583058100Z  + IFS=

	2021-12-31T11:40:58.583074700Z  + read -r subsystem

	2021-12-31T11:40:58.583079100Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/blkio

	2021-12-31T11:40:58.583082900Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.583086400Z  + local subsystem=/sys/fs/cgroup/blkio

	2021-12-31T11:40:58.583564100Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.583580800Z  + mkdir -p /sys/fs/cgroup/blkio//kubelet

	2021-12-31T11:40:58.585467000Z  + '[' /sys/fs/cgroup/blkio == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.585483200Z  + mount --bind /sys/fs/cgroup/blkio//kubelet /sys/fs/cgroup/blkio//kubelet

	2021-12-31T11:40:58.588906600Z  + IFS=

	2021-12-31T11:40:58.588928500Z  + read -r subsystem

	2021-12-31T11:40:58.588952700Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/memory

	2021-12-31T11:40:58.588981500Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.588985100Z  + local subsystem=/sys/fs/cgroup/memory

	2021-12-31T11:40:58.590570900Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.590702100Z  + mkdir -p /sys/fs/cgroup/memory//kubelet

	2021-12-31T11:40:58.596832900Z  + '[' /sys/fs/cgroup/memory == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.596850000Z  + mount --bind /sys/fs/cgroup/memory//kubelet /sys/fs/cgroup/memory//kubelet

	2021-12-31T11:40:58.602341000Z  + IFS=

	2021-12-31T11:40:58.602364400Z  + read -r subsystem

	2021-12-31T11:40:58.602371300Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/devices

	2021-12-31T11:40:58.602377700Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.603911000Z  + local subsystem=/sys/fs/cgroup/devices

	2021-12-31T11:40:58.605155200Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.605175500Z  + mkdir -p /sys/fs/cgroup/devices//kubelet

	2021-12-31T11:40:58.608088300Z  + '[' /sys/fs/cgroup/devices == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.608111100Z  + mount --bind /sys/fs/cgroup/devices//kubelet /sys/fs/cgroup/devices//kubelet

	2021-12-31T11:40:58.610676600Z  + IFS=

	2021-12-31T11:40:58.610702600Z  + read -r subsystem

	2021-12-31T11:40:58.610728400Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/freezer

	2021-12-31T11:40:58.610736700Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.610744500Z  + local subsystem=/sys/fs/cgroup/freezer

	2021-12-31T11:40:58.610751600Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.610971400Z  + mkdir -p /sys/fs/cgroup/freezer//kubelet

	2021-12-31T11:40:58.613407000Z  + '[' /sys/fs/cgroup/freezer == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.613429200Z  + mount --bind /sys/fs/cgroup/freezer//kubelet /sys/fs/cgroup/freezer//kubelet

	2021-12-31T11:40:58.616622000Z  + IFS=

	2021-12-31T11:40:58.616642900Z  + read -r subsystem

	2021-12-31T11:40:58.616665200Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/net_cls

	2021-12-31T11:40:58.616691100Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.616696700Z  + local subsystem=/sys/fs/cgroup/net_cls

	2021-12-31T11:40:58.616701700Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.616706900Z  + mkdir -p /sys/fs/cgroup/net_cls//kubelet

	2021-12-31T11:40:58.621548000Z  + '[' /sys/fs/cgroup/net_cls == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.621576800Z  + mount --bind /sys/fs/cgroup/net_cls//kubelet /sys/fs/cgroup/net_cls//kubelet

	2021-12-31T11:40:58.627430600Z  + IFS=

	2021-12-31T11:40:58.627468600Z  + read -r subsystem

	2021-12-31T11:40:58.627475900Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/perf_event

	2021-12-31T11:40:58.627498000Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.627509800Z  + local subsystem=/sys/fs/cgroup/perf_event

	2021-12-31T11:40:58.627518300Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.627523700Z  + mkdir -p /sys/fs/cgroup/perf_event//kubelet

	2021-12-31T11:40:58.631747900Z  + '[' /sys/fs/cgroup/perf_event == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.631773900Z  + mount --bind /sys/fs/cgroup/perf_event//kubelet /sys/fs/cgroup/perf_event//kubelet

	2021-12-31T11:40:58.634905800Z  + IFS=

	2021-12-31T11:40:58.634927500Z  + read -r subsystem

	2021-12-31T11:40:58.634934100Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/net_prio

	2021-12-31T11:40:58.634940000Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.634945600Z  + local subsystem=/sys/fs/cgroup/net_prio

	2021-12-31T11:40:58.634951100Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.634956500Z  + mkdir -p /sys/fs/cgroup/net_prio//kubelet

	2021-12-31T11:40:58.637743300Z  + '[' /sys/fs/cgroup/net_prio == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.637766600Z  + mount --bind /sys/fs/cgroup/net_prio//kubelet /sys/fs/cgroup/net_prio//kubelet

	2021-12-31T11:40:58.641063700Z  + IFS=

	2021-12-31T11:40:58.641086500Z  + read -r subsystem

	2021-12-31T11:40:58.641093800Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/hugetlb

	2021-12-31T11:40:58.641099700Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.641105200Z  + local subsystem=/sys/fs/cgroup/hugetlb

	2021-12-31T11:40:58.641110600Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.641116500Z  + mkdir -p /sys/fs/cgroup/hugetlb//kubelet

	2021-12-31T11:40:58.643550900Z  + '[' /sys/fs/cgroup/hugetlb == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.643568300Z  + mount --bind /sys/fs/cgroup/hugetlb//kubelet /sys/fs/cgroup/hugetlb//kubelet

	2021-12-31T11:40:58.646328300Z  + IFS=

	2021-12-31T11:40:58.646369900Z  + read -r subsystem

	2021-12-31T11:40:58.646378000Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/pids

	2021-12-31T11:40:58.646388500Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.646397900Z  + local subsystem=/sys/fs/cgroup/pids

	2021-12-31T11:40:58.646404400Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.646899600Z  + mkdir -p /sys/fs/cgroup/pids//kubelet

	2021-12-31T11:40:58.648501100Z  + '[' /sys/fs/cgroup/pids == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.648515000Z  + mount --bind /sys/fs/cgroup/pids//kubelet /sys/fs/cgroup/pids//kubelet

	2021-12-31T11:40:58.651244800Z  + IFS=

	2021-12-31T11:40:58.651260000Z  + read -r subsystem

	2021-12-31T11:40:58.651264100Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/systemd

	2021-12-31T11:40:58.651267800Z  + local cgroup_root=/kubelet

	2021-12-31T11:40:58.651271100Z  + local subsystem=/sys/fs/cgroup/systemd

	2021-12-31T11:40:58.651287200Z  + '[' -z /kubelet ']'

	2021-12-31T11:40:58.651291000Z  + mkdir -p /sys/fs/cgroup/systemd//kubelet

	2021-12-31T11:40:58.653410900Z  + '[' /sys/fs/cgroup/systemd == /sys/fs/cgroup/cpuset ']'

	2021-12-31T11:40:58.653425200Z  + mount --bind /sys/fs/cgroup/systemd//kubelet /sys/fs/cgroup/systemd//kubelet

	2021-12-31T11:40:58.656129300Z  + IFS=

	2021-12-31T11:40:58.656149200Z  + read -r subsystem

	2021-12-31T11:40:58.656157300Z  + return

	2021-12-31T11:40:58.656162700Z  + fix_machine_id

	2021-12-31T11:40:58.656168500Z  + echo 'INFO: clearing and regenerating /etc/machine-id'

	2021-12-31T11:40:58.656173900Z  INFO: clearing and regenerating /etc/machine-id

	2021-12-31T11:40:58.656179500Z  + rm -f /etc/machine-id

	2021-12-31T11:40:58.658858200Z  + systemd-machine-id-setup

	2021-12-31T11:40:58.665514400Z  Initializing machine ID from D-Bus machine ID.

	2021-12-31T11:40:58.680704800Z  + fix_product_name

	2021-12-31T11:40:58.680723800Z  + [[ -f /sys/class/dmi/id/product_name ]]

	2021-12-31T11:40:58.680728700Z  + fix_product_uuid

	2021-12-31T11:40:58.680732300Z  + [[ ! -f /kind/product_uuid ]]

	2021-12-31T11:40:58.680735900Z  + cat /proc/sys/kernel/random/uuid

	2021-12-31T11:40:58.683342000Z  + [[ -f /sys/class/dmi/id/product_uuid ]]

	2021-12-31T11:40:58.683365600Z  + [[ -f /sys/devices/virtual/dmi/id/product_uuid ]]

	2021-12-31T11:40:58.683375500Z  + select_iptables

	2021-12-31T11:40:58.683382400Z  + local mode=nft

	2021-12-31T11:40:58.685658400Z  ++ grep '^-'

	2021-12-31T11:40:58.685675600Z  ++ wc -l

	2021-12-31T11:40:58.817980000Z  + num_legacy_lines=6

	2021-12-31T11:40:58.818015800Z  + '[' 6 -ge 10 ']'

	2021-12-31T11:40:58.824617600Z  ++ grep '^-'

	2021-12-31T11:40:58.824709900Z  ++ wc -l

	2021-12-31T11:40:58.837439000Z  ++ true

	2021-12-31T11:40:58.837466400Z  + num_nft_lines=0

	2021-12-31T11:40:58.837491200Z  + '[' 6 -ge 0 ']'

	2021-12-31T11:40:58.837497500Z  + mode=legacy

	2021-12-31T11:40:58.837503700Z  + echo 'INFO: setting iptables to detected mode: legacy'

	2021-12-31T11:40:58.838498800Z  INFO: setting iptables to detected mode: legacy

	2021-12-31T11:40:58.838522600Z  + update-alternatives --set iptables /usr/sbin/iptables-legacy

	2021-12-31T11:40:58.839325200Z  + echo 'retryable update-alternatives: --set iptables /usr/sbin/iptables-legacy'

	2021-12-31T11:40:58.839343700Z  + local 'args=--set iptables /usr/sbin/iptables-legacy'

	2021-12-31T11:40:58.840542000Z  ++ seq 0 15

	2021-12-31T11:40:58.841719900Z  + for i in $(seq 0 15)

	2021-12-31T11:40:58.841737300Z  + /usr/bin/update-alternatives --set iptables /usr/sbin/iptables-legacy

	2021-12-31T11:40:58.855069600Z  + return

	2021-12-31T11:40:58.855089900Z  + update-alternatives --set ip6tables /usr/sbin/ip6tables-legacy

	2021-12-31T11:40:58.855095000Z  + echo 'retryable update-alternatives: --set ip6tables /usr/sbin/ip6tables-legacy'

	2021-12-31T11:40:58.855099100Z  + local 'args=--set ip6tables /usr/sbin/ip6tables-legacy'

	2021-12-31T11:40:58.856447100Z  ++ seq 0 15

	2021-12-31T11:40:58.857898300Z  + for i in $(seq 0 15)

	2021-12-31T11:40:58.857915700Z  + /usr/bin/update-alternatives --set ip6tables /usr/sbin/ip6tables-legacy

	2021-12-31T11:40:58.870754100Z  + return

	2021-12-31T11:40:58.870775400Z  + enable_network_magic

	2021-12-31T11:40:58.870780400Z  + local docker_embedded_dns_ip=127.0.0.11

	2021-12-31T11:40:58.870784100Z  + local docker_host_ip

	2021-12-31T11:40:58.873277500Z  ++ cut '-d ' -f1

	2021-12-31T11:40:58.873320700Z  ++ head -n1 /dev/fd/63

	2021-12-31T11:40:58.873333300Z  +++ getent ahostsv4 host.docker.internal

	2021-12-31T11:40:58.884899600Z  + docker_host_ip=192.168.65.2

	2021-12-31T11:40:58.885000300Z  + [[ -z 192.168.65.2 ]]

	2021-12-31T11:40:58.885012000Z  + [[ 192.168.65.2 =~ ^127\.[0-9]+\.[0-9]+\.[0-9]+$ ]]

	2021-12-31T11:40:58.885992700Z  + iptables-save

	2021-12-31T11:40:58.887395000Z  + iptables-restore

	2021-12-31T11:40:58.888966400Z  + sed -e 's/-d 127.0.0.11/-d 192.168.65.2/g' -e 's/-A OUTPUT \(.*\) -j DOCKER_OUTPUT/\0\n-A PREROUTING \1 -j DOCKER_OUTPUT/' -e 's/--to-source :53/--to-source 192.168.65.2:53/g'

	2021-12-31T11:40:59.002092600Z  + cp /etc/resolv.conf /etc/resolv.conf.original

	2021-12-31T11:40:59.005672700Z  + sed -e s/127.0.0.11/192.168.65.2/g /etc/resolv.conf.original

	2021-12-31T11:40:59.018559200Z  ++ cut '-d ' -f1

	2021-12-31T11:40:59.018584100Z  ++ head -n1 /dev/fd/63

	2021-12-31T11:40:59.018592500Z  ++++ hostname

	2021-12-31T11:40:59.021526800Z  +++ getent ahostsv4 default-k8s-different-port-20211231113947-1576

	2021-12-31T11:40:59.028367000Z  + curr_ipv4=192.168.67.2

	2021-12-31T11:40:59.028388800Z  + echo 'INFO: Detected IPv4 address: 192.168.67.2'

	2021-12-31T11:40:59.028397400Z  INFO: Detected IPv4 address: 192.168.67.2

	2021-12-31T11:40:59.028403300Z  + '[' -f /kind/old-ipv4 ']'

	2021-12-31T11:40:59.028408900Z  + [[ -n 192.168.67.2 ]]

	2021-12-31T11:40:59.028414400Z  + echo -n 192.168.67.2

	2021-12-31T11:40:59.034387600Z  ++ head -n1 /dev/fd/63

	2021-12-31T11:40:59.034503100Z  ++ cut '-d ' -f1

	2021-12-31T11:40:59.034516300Z  ++++ hostname

	2021-12-31T11:40:59.036858600Z  +++ getent ahostsv6 default-k8s-different-port-20211231113947-1576

	2021-12-31T11:40:59.040250900Z  + curr_ipv6=

	2021-12-31T11:40:59.040275600Z  + echo 'INFO: Detected IPv6 address: '

	2021-12-31T11:40:59.040300800Z  INFO: Detected IPv6 address: 

	2021-12-31T11:40:59.040309100Z  + '[' -f /kind/old-ipv6 ']'

	2021-12-31T11:40:59.040315000Z  + [[ -n '' ]]

	2021-12-31T11:40:59.041616600Z  ++ uname -a

	2021-12-31T11:40:59.043132900Z  + echo 'entrypoint completed: Linux default-k8s-different-port-20211231113947-1576 5.10.16.3-microsoft-standard-WSL2 #1 SMP Fri Apr 2 22:23:49 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux'

	2021-12-31T11:40:59.043150500Z  entrypoint completed: Linux default-k8s-different-port-20211231113947-1576 5.10.16.3-microsoft-standard-WSL2 #1 SMP Fri Apr 2 22:23:49 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

	2021-12-31T11:40:59.043155600Z  + exec /sbin/init

	2021-12-31T11:40:59.053486100Z  systemd 245.4-4ubuntu3.13 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid)

	2021-12-31T11:40:59.053509800Z  Detected virtualization wsl.

	2021-12-31T11:40:59.053518200Z  Detected architecture x86-64.

	2021-12-31T11:40:59.057619500Z  Failed to create symlink /sys/fs/cgroup/net_cls: File exists

	2021-12-31T11:40:59.057637900Z  Failed to create symlink /sys/fs/cgroup/net_prio: File exists

	2021-12-31T11:40:59.057643100Z  Failed to create symlink /sys/fs/cgroup/cpuacct: File exists

	2021-12-31T11:40:59.057647100Z  Failed to create symlink /sys/fs/cgroup/cpu: File exists

	2021-12-31T11:40:59.058668200Z  

	2021-12-31T11:40:59.058702300Z  Welcome to Ubuntu 20.04.2 LTS!

	2021-12-31T11:40:59.058728700Z  

	2021-12-31T11:40:59.058734500Z  Set hostname to <default-k8s-different-port-20211231113947-1576>.

	2021-12-31T11:40:59.128967500Z  [  OK  ] Started Dispatch Password …ts to Console Directory Watch.

	2021-12-31T11:40:59.129020700Z  [  OK  ] Set up automount Arbitrary…s File System Automount Point.

	2021-12-31T11:40:59.130031900Z  [  OK  ] Reached target Local Encrypted Volumes.

	2021-12-31T11:40:59.130054300Z  [  OK  ] Reached target Network is Online.

	2021-12-31T11:40:59.130061200Z  [  OK  ] Reached target Paths.

	2021-12-31T11:40:59.130142100Z  [  OK  ] Reached target Slices.

	2021-12-31T11:40:59.130150100Z  [  OK  ] Reached target Swap.

	2021-12-31T11:40:59.131393200Z  [  OK  ] Listening on Journal Socket (/dev/log).

	2021-12-31T11:40:59.131419500Z  [  OK  ] Listening on Journal Socket.

	2021-12-31T11:40:59.136926500Z           Mounting Huge Pages File System...

	2021-12-31T11:40:59.140334200Z           Mounting Kernel Debug File System...

	2021-12-31T11:40:59.143890700Z           Mounting Kernel Trace File System...

	2021-12-31T11:40:59.150312900Z           Starting Journal Service...

	2021-12-31T11:40:59.154301000Z           Mounting FUSE Control File System...

	2021-12-31T11:40:59.157447300Z           Starting Remount Root and Kernel File Systems...

	2021-12-31T11:40:59.161305700Z           Starting Apply Kernel Variables...

	2021-12-31T11:40:59.164313400Z  [  OK  ] Mounted Huge Pages File System.

	2021-12-31T11:40:59.164335900Z  [  OK  ] Mounted Kernel Debug File System.

	2021-12-31T11:40:59.165288100Z  [  OK  ] Mounted Kernel Trace File System.

	2021-12-31T11:40:59.165312400Z  [  OK  ] Mounted FUSE Control File System.

	2021-12-31T11:40:59.168069600Z  [  OK  ] Finished Remount Root and Kernel File Systems.

	2021-12-31T11:40:59.171161100Z           Starting Create System Users...

	2021-12-31T11:40:59.173245900Z           Starting Update UTMP about System Boot/Shutdown...

	2021-12-31T11:40:59.175156400Z  [  OK  ] Finished Apply Kernel Variables.

	2021-12-31T11:40:59.189316100Z  [  OK  ] Finished Update UTMP about System Boot/Shutdown.

	2021-12-31T11:40:59.205049800Z  [  OK  ] Started Journal Service.

	2021-12-31T11:40:59.213946300Z           Starting Flush Journal to Persistent Storage...

	2021-12-31T11:40:59.225033900Z  [  OK  ] Finished Flush Journal to Persistent Storage.

	2021-12-31T11:40:59.293153500Z  [  OK  ] Finished Create System Users.

	2021-12-31T11:40:59.295274800Z           Starting Create Static Device Nodes in /dev...

	2021-12-31T11:40:59.304261500Z  [  OK  ] Finished Create Static Device Nodes in /dev.

	2021-12-31T11:40:59.304866500Z  [  OK  ] Reached target Local File Systems (Pre).

	2021-12-31T11:40:59.304890700Z  [  OK  ] Reached target Local File Systems.

	2021-12-31T11:40:59.305524100Z  [  OK  ] Reached target System Initialization.

	2021-12-31T11:40:59.305548300Z  [  OK  ] Started Daily Cleanup of Temporary Directories.

	2021-12-31T11:40:59.305557000Z  [  OK  ] Reached target Timers.

	2021-12-31T11:40:59.306389400Z  [  OK  ] Listening on BuildKit.

	2021-12-31T11:40:59.306429300Z  [  OK  ] Listening on D-Bus System Message Bus Socket.

	2021-12-31T11:40:59.308566600Z           Starting Docker Socket for the API.

	2021-12-31T11:40:59.310732800Z           Starting Podman API Socket.

	2021-12-31T11:40:59.311599700Z  [  OK  ] Listening on Docker Socket for the API.

	2021-12-31T11:40:59.312792700Z  [  OK  ] Listening on Podman API Socket.

	2021-12-31T11:40:59.313564900Z  [  OK  ] Reached target Sockets.

	2021-12-31T11:40:59.314804800Z  [  OK  ] Reached target Basic System.

	2021-12-31T11:40:59.317214300Z           Starting containerd container runtime...

	2021-12-31T11:40:59.321862400Z  [  OK  ] Started D-Bus System Message Bus.

	2021-12-31T11:40:59.327576800Z           Starting minikube automount...

	2021-12-31T11:40:59.331173700Z           Starting OpenBSD Secure Shell server...

	2021-12-31T11:40:59.363570500Z  [  OK  ] Finished minikube automount.

	2021-12-31T11:40:59.368856100Z  [  OK  ] Started OpenBSD Secure Shell server.

	2021-12-31T11:40:59.516794800Z  [  OK  ] Started containerd container runtime.

	2021-12-31T11:40:59.523444800Z           Starting Docker Application Container Engine...

	2021-12-31T11:41:01.702561000Z  [*     ] A start job is running for Docker A…n Container Engine (2s / no limit)

	2021-12-31T11:41:02.201845000Z  M
[**    ] A start job is running for Docker A…n Container Engine (3s / no limit)

	2021-12-31T11:41:02.649643500Z  M
[  OK  ] Started Docker Application Container Engine.

	2021-12-31T11:41:02.649856900Z  [  OK  ] Reached target Multi-User System.

	2021-12-31T11:41:02.649874800Z  [  OK  ] Reached target Graphical Interface.

	2021-12-31T11:41:02.653974800Z           Starting Update UTMP about System Runlevel Changes...

	2021-12-31T11:41:02.678892500Z  [  OK  ] Finished Update UTMP about System Runlevel Changes.

	2021-12-31T11:43:23.058076200Z  [  OK  ] Stopped target Graphical Interface.

	2021-12-31T11:43:23.058336300Z  [  OK  ] Stopped target Multi-User System.

	2021-12-31T11:43:23.059140800Z  [  OK  ] Stopped target Timers.

	2021-12-31T11:43:23.059764700Z  [  OK  ] Stopped Daily Cleanup of Temporary Directories.

	2021-12-31T11:43:23.066365600Z           Stopping D-Bus System Message Bus...

	2021-12-31T11:43:23.068751700Z           Stopping Docker Application Container Engine...

	2021-12-31T11:43:23.069550500Z           Stopping kubelet: The Kubernetes Node Agent...

	2021-12-31T11:43:23.071127600Z           Stopping OpenBSD Secure Shell server...

	2021-12-31T11:43:23.075100600Z  [  OK  ] Stopped OpenBSD Secure Shell server.

	2021-12-31T11:43:23.076992200Z  [  OK  ] Stopped D-Bus System Message Bus.

	2021-12-31T11:43:23.316317700Z  [  OK  ] Stopped kubelet: The Kubernetes Node Agent.

	2021-12-31T11:43:23.920716700Z  [  OK  ] Unmounted /var/lib/docker/…33646176739269750804d3/merged.

	2021-12-31T11:43:24.017076900Z  [  OK  ] Unmounted /var/lib/docker/…0fe15fff201500abfcc048/merged.

	2021-12-31T11:43:24.157661600Z  [  OK  ] Unmounted /var/lib/docker/…08ee38a355f8ef5cb00c43/merged.

	2021-12-31T11:43:24.279570800Z  [  OK  ] Unmounted /var/lib/docker/…223326a1348aff9f7e374f/merged.

	2021-12-31T11:43:24.281535000Z  [  OK  ] Unmounted /var/lib/docker/…600ce92c551d77b7b6/mounts/shm.

	2021-12-31T11:43:24.283316400Z  [  OK  ] Unmounted /var/lib/docker/…a1cb49c753bca701ee75c2/merged.

	2021-12-31T11:43:24.357676600Z  [  OK  ] Unmounted /var/lib/docker/…ef875aaaa878998aee/mounts/shm.

	2021-12-31T11:43:24.359050800Z  [  OK  ] Unmounted /var/lib/docker/…0027f8abc57b3f73dbc3e6/merged.

	2021-12-31T11:43:24.402749200Z  [  OK  ] Unmounted /var/lib/docker/…8cfb7c9f73a861b3ce/mounts/shm.

	2021-12-31T11:43:24.404576400Z  [  OK  ] Unmounted /var/lib/docker/…ebb03e4c5d84316247fcc7/merged.

	2021-12-31T11:43:24.408549800Z  [  OK  ] Unmounted /var/lib/docker/…de0001bb6c76c49163/mounts/shm.

	2021-12-31T11:43:24.410479300Z  [  OK  ] Unmounted /var/lib/docker/…bd0177921301203963709f/merged.

	2021-12-31T11:43:24.432839800Z  [  OK  ] Unmounted /var/lib/docker/…2ee14e381438783bb8/mounts/shm.

	2021-12-31T11:43:24.434265700Z  [  OK  ] Unmounted /var/lib/docker/…25a87613716c7c81e97e63/merged.

	2021-12-31T11:43:24.442771900Z  [  OK  ] Unmounted /var/lib/docker/…dac36e08d88b63c2ae/mounts/shm.

	2021-12-31T11:43:24.442802100Z  [  OK  ] Unmounted /var/lib/docker/…bb5a64fadbe93f5de1d4e4/merged.

	2021-12-31T11:43:25.128503600Z  [  OK  ] Unmounted /run/docker/netns/08dbd9f9e457.

	2021-12-31T11:43:25.136038500Z  [  OK  ] Unmounted /var/lib/docker/…4676f27800f0dc8043/mounts/shm.

	2021-12-31T11:43:25.136095700Z  [  OK  ] Unmounted /var/lib/docker/…d3280b1d8dd91d80946ec5/merged.

	2021-12-31T11:43:25.359706400Z  [  OK  ] Unmounted /run/docker/netns/4b11d162ab34.

	2021-12-31T11:43:25.369092900Z  [  OK  ] Unmounted /var/lib/docker/…fddc2f870d53d3f9a4/mounts/shm.

	2021-12-31T11:43:25.369368000Z  [  OK  ] Unmounted /var/lib/docker/…e5157c4555b3aaf137ab8d/merged.

	2021-12-31T11:43:25.556390500Z  [  OK  ] Unmounted /run/docker/netns/9de6c3cdac26.

	2021-12-31T11:43:25.565728400Z  [  OK  ] Unmounted /var/lib/docker/…58862b686a9087cf23/mounts/shm.

	2021-12-31T11:43:25.565893700Z  [  OK  ] Unmounted /var/lib/docker/…04f175733206115914afae/merged.

	2021-12-31T11:43:27.702102000Z  [   ***] A stop job is running for Docker Ap…n Container Engine (4s / 1min 30s)

	2021-12-31T11:43:28.201971700Z  M
[    **] A stop job is running for Docker Ap…n Container Engine (5s / 1min 30s)

	2021-12-31T11:43:28.702099300Z  M
[     *] A stop job is running for Docker Ap…n Container Engine (5s / 1min 30s)

	2021-12-31T11:43:28.719573700Z  M
[  OK  ] Unmounted /var/lib/docker/…9802e6d3d034a1e147865b/merged.

	2021-12-31T11:43:32.702122200Z  [    **] A stop job is running for Docker Ap…n Container Engine (9s / 1min 30s)

	2021-12-31T11:43:33.202113800Z  M
[   ***] A stop job is running for Docker Ap… Container Engine (10s / 1min 30s)

	2021-12-31T11:43:33.414863300Z  M
[  OK  ] Unmounted /var/lib/docker/…870680a43106a8ee8f4d6a/merged.

	2021-12-31T11:43:33.686396800Z  [  OK  ] Unmounted /var/lib/docker/…0a4bc36d33f6cb89d9cf5e/merged.

	2021-12-31T11:43:33.835685800Z  [  OK  ] Unmounted /var/lib/docker/…5f26f0e1cbcbc2585f5598/merged.

	2021-12-31T11:43:33.977055700Z  [  OK  ] Stopped Docker Application Container Engine.

	2021-12-31T11:43:33.978352100Z  [  OK  ] Stopped target Network is Online.

	2021-12-31T11:43:33.979706400Z           Stopping containerd container runtime...

	2021-12-31T11:43:33.985723100Z  [  OK  ] Stopped minikube automount.

	2021-12-31T11:43:33.994121700Z  [  OK  ] Stopped containerd container runtime.

	2021-12-31T11:43:33.995101900Z  [  OK  ] Stopped target Basic System.

	2021-12-31T11:43:33.995118100Z  [  OK  ] Stopped target Paths.

	2021-12-31T11:43:33.995900200Z  [  OK  ] Stopped target Slices.

	2021-12-31T11:43:33.995917600Z  [  OK  ] Stopped target Sockets.

	2021-12-31T11:43:33.998440800Z  [  OK  ] Closed BuildKit.

	2021-12-31T11:43:34.000958100Z  [  OK  ] Closed D-Bus System Message Bus Socket.

	2021-12-31T11:43:34.003244100Z  [  OK  ] Closed Docker Socket for the API.

	2021-12-31T11:43:34.006101300Z  [  OK  ] Closed Podman API Socket.

	2021-12-31T11:43:34.006119800Z  [  OK  ] Stopped target System Initialization.

	2021-12-31T11:43:34.007076100Z  [  OK  ] Stopped target Local Encrypted Volumes.

	2021-12-31T11:43:34.052341200Z  [  OK  ] Stopped Dispatch Password …ts to Console Directory Watch.

	2021-12-31T11:43:34.052449100Z  [  OK  ] Stopped target Local File Systems.

	2021-12-31T11:43:34.054451700Z           Unmounting /data...

	2021-12-31T11:43:34.056722300Z           Unmounting /etc/hostname...

	2021-12-31T11:43:34.058591300Z           Unmounting /etc/hosts...

	2021-12-31T11:43:34.061052300Z           Unmounting /etc/resolv.conf...

	2021-12-31T11:43:34.069148100Z           Unmounting /run/docker/netns/default...

	2021-12-31T11:43:34.073321700Z           Unmounting /tmp/hostpath-provisioner...

	2021-12-31T11:43:34.075218900Z           Unmounting /tmp/hostpath_pv...

	2021-12-31T11:43:34.077516100Z           Unmounting /usr/lib/modules...

	2021-12-31T11:43:34.081160300Z           Unmounting /var/lib/kubele…ected/kube-api-access-dqbp9...

	2021-12-31T11:43:34.084501700Z           Unmounting /var/lib/kubele…ected/kube-api-access-r4gfc...

	2021-12-31T11:43:34.087474400Z           Unmounting /var/lib/kubele…ected/kube-api-access-d62t8...

	2021-12-31T11:43:34.090753700Z           Unmounting /var/lib/kubele…ected/kube-api-access-4p6kj...

	2021-12-31T11:43:34.093690000Z           Unmounting /var/lib/kubele…ected/kube-api-access-74kcm...

	2021-12-31T11:43:34.096186800Z  [  OK  ] Stopped Apply Kernel Variables.

	2021-12-31T11:43:34.097538400Z           Stopping Update UTMP about System Boot/Shutdown...

	2021-12-31T11:43:34.104650800Z  [  OK  ] Unmounted /data.

	2021-12-31T11:43:34.106595700Z  [  OK  ] Unmounted /etc/hostname.

	2021-12-31T11:43:34.109079900Z  [  OK  ] Unmounted /etc/hosts.

	2021-12-31T11:43:34.111632600Z  [  OK  ] Unmounted /etc/resolv.conf.

	2021-12-31T11:43:34.113497200Z  [  OK  ] Unmounted /run/docker/netns/default.

	2021-12-31T11:43:34.115548000Z  [  OK  ] Unmounted /tmp/hostpath-provisioner.

	2021-12-31T11:43:34.118148700Z  [  OK  ] Unmounted /tmp/hostpath_pv.

	2021-12-31T11:43:34.120487100Z  [  OK  ] Unmounted /usr/lib/modules.

	2021-12-31T11:43:34.122850000Z  [  OK  ] Unmounted /var/lib/kubelet…ojected/kube-api-access-dqbp9.

	2021-12-31T11:43:34.125378700Z  [  OK  ] Unmounted /var/lib/kubelet…ojected/kube-api-access-r4gfc.

	2021-12-31T11:43:34.128410700Z  [  OK  ] Unmounted /var/lib/kubelet…ojected/kube-api-access-d62t8.

	2021-12-31T11:43:34.130991800Z  [  OK  ] Unmounted /var/lib/kubelet…ojected/kube-api-access-4p6kj.

	2021-12-31T11:43:34.133301500Z  [  OK  ] Unmounted /var/lib/kubelet…ojected/kube-api-access-74kcm.

	2021-12-31T11:43:34.137880600Z           Unmounting /tmp...

	2021-12-31T11:43:34.141183100Z  [  OK  ] Stopped Update UTMP about System Boot/Shutdown.

	2021-12-31T11:43:34.147061800Z  [  OK  ] Unmounted /tmp.

	2021-12-31T11:43:34.148152100Z  [  OK  ] Stopped target Swap.

	2021-12-31T11:43:34.149541600Z           Unmounting /var...

	2021-12-31T11:43:34.157733500Z  [  OK  ] Unmounted /var.

	2021-12-31T11:43:34.158450800Z  [  OK  ] Stopped target Local File Systems (Pre).

	2021-12-31T11:43:34.158475700Z  [  OK  ] Reached target Unmount All Filesystems.

	2021-12-31T11:43:34.162545100Z  [  OK  ] Stopped Create Static Device Nodes in /dev.

	2021-12-31T11:43:34.165622800Z  [  OK  ] Stopped Create System Users.

	2021-12-31T11:43:34.168344500Z  [  OK  ] Stopped Remount Root and Kernel File Systems.

	2021-12-31T11:43:34.168365700Z  [  OK  ] Reached target Shutdown.

	2021-12-31T11:43:34.168984400Z  [  OK  ] Reached target Final Step.

	2021-12-31T11:43:34.170366700Z  [  OK  ] Finished Power-Off.

	2021-12-31T11:43:34.170400000Z  [  OK  ] Reached target Power-Off.

	-- /stdout --

	I1231 11:44:30.054534   10808 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:44:32.382391   10808 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.3277636s)

	I1231 11:44:32.382391   10808 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:46 OomKillDisable:true NGoroutines:45 SystemTime:2021-12-31 11:44:31.2779393 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_

bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:44:32.382391   10808 errors.go:98] postmortem docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:46 OomKillDisable:true NGoroutines:45 SystemTime:2021-12-31 11:44:31.2779393 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Archit

ecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio th

rottle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:44:32.391360   10808 network_create.go:254] running [docker network inspect default-k8s-different-port-20211231113947-1576] to gather additional debugging logs...

	I1231 11:44:32.391360   10808 cli_runner.go:133] Run: docker network inspect default-k8s-different-port-20211231113947-1576

	W1231 11:44:39.963861   10808 cli_runner.go:180] docker network inspect default-k8s-different-port-20211231113947-1576 returned with exit code 1

	I1231 11:44:39.963994   10808 cli_runner.go:186] Completed: docker network inspect default-k8s-different-port-20211231113947-1576: (7.5724684s)

	I1231 11:44:39.964037   10808 network_create.go:257] error running [docker network inspect default-k8s-different-port-20211231113947-1576]: docker network inspect default-k8s-different-port-20211231113947-1576: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: default-k8s-different-port-20211231113947-1576

	I1231 11:44:39.964037   10808 network_create.go:259] output of [docker network inspect default-k8s-different-port-20211231113947-1576]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: default-k8s-different-port-20211231113947-1576

	** /stderr **

	I1231 11:44:39.973229   10808 cli_runner.go:133] Run: docker system info --format "{{json .}}"

	I1231 11:44:42.297345   10808 cli_runner.go:186] Completed: docker system info --format "{{json .}}": (2.3241059s)

	I1231 11:44:42.297345   10808 info.go:263] docker info: {ID:TFIJ:2W3D:26R4:PMAP:MOHM:TB5Y:WJL3:GLEY:6USK:QG36:YMHH:IWD7 Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:46 OomKillDisable:true NGoroutines:45 SystemTime:2021-12-31 11:44:41.2274228 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.16.3-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53910265856 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.11 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7b11cfaabd73bb80907dd23182b9347b4245eb5d Expected:7b11cfaabd73bb80907dd23182b9347b4245eb5d} RuncCommit:{ID:v1.0.2-0-g52b36a2 Expected:v1.0.2-0-g52b36a2} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_

bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.7.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.2.1] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.11.0]] Warnings:<nil>}}

	I1231 11:44:42.306518   10808 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20211231113947-1576

	I1231 11:44:43.691134   10808 cli_runner.go:186] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-different-port-20211231113947-1576: (1.3845352s)

	I1231 11:44:43.691134   10808 profile.go:147] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\default-k8s-different-port-20211231113947-1576\config.json ...

	I1231 11:44:43.693158   10808 machine.go:88] provisioning docker machine ...

	I1231 11:44:43.694112   10808 ubuntu.go:169] provisioning hostname "default-k8s-different-port-20211231113947-1576"

	I1231 11:44:43.699110   10808 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576

	W1231 11:44:44.986427   10808 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576 returned with exit code 1

	I1231 11:44:44.986511   10808 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576: (1.2873117s)

	I1231 11:44:44.986620   10808 machine.go:91] provisioned docker machine in 1.2934562s

	I1231 11:44:44.994987   10808 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1231 11:44:45.001195   10808 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576

	W1231 11:44:46.330456   10808 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576 returned with exit code 1

	I1231 11:44:46.330456   10808 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576: (1.3292551s)

	I1231 11:44:46.330456   10808 retry.go:31] will retry after 291.140013ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I1231 11:44:46.629803   10808 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576

	W1231 11:44:47.964517   10808 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576 returned with exit code 1

	I1231 11:44:47.964517   10808 cli_runner.go:186] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20211231113947-1576: (1.3347087s)

	W1231 11:44:47.964517   10808 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W1231 11:44:47.964517   10808 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I1231 11:44:47.964517   10808 fix.go:57] fixHost completed within 24.2596606s

	I1231 11:44:47.964517   10808 start.go:80] releasing machines lock for "default-k8s-different-port-20211231113947-1576", held for 24.2596606s

	W1231 11:44:47.964517   10808 out.go:241] * Failed to start docker container. Running "minikube delete -p default-k8s-different-port-20211231113947-1576" may fix it: provision: get ssh host-port: unable to inspect a not running container to get SSH port

	* Failed to start docker container. Running "minikube delete -p default-k8s-different-port-20211231113947-1576" may fix it: provision: get ssh host-port: unable to inspect a not running container to get SSH port

	I1231 11:44:47.973513   10808 out.go:176] 

	W1231 11:44:47.973513   10808 out.go:241] X Exiting due to GUEST_PROVISION_CONTAINER_EXITED: Docker container exited prematurely after it was created, consider investigating Docker's performance/health.

	X Exiting due to GUEST_PROVISION_CONTAINER_EXITED: Docker container exited prematurely after it was created, consider investigating Docker's performance/health.

	I1231 11:44:47.976521   10808 out.go:176] 

** /stderr **

start_stop_delete_test.go:244: failed to start minikube post-stop. args "out/minikube-windows-amd64.exe start -p default-k8s-different-port-20211231113947-1576 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --kubernetes-version=v1.23.1": exit status 80

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/SecondStart]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect default-k8s-different-port-20211231113947-1576

helpers_test.go:232: (dbg) Done: docker inspect default-k8s-different-port-20211231113947-1576: (1.4263987s)

helpers_test.go:236: (dbg) docker inspect default-k8s-different-port-20211231113947-1576:

-- stdout --

	[

	    {

	        "Id": "11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106",

	        "Created": "2021-12-31T11:40:54.5144635Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "exited",

	            "Running": false,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 0,

	            "ExitCode": 130,

	            "Error": "network 28f2b467e2029f6c69bcf00096c983d688568193b5931ffd81919f4d2577d2d5 not found",

	            "StartedAt": "2021-12-31T11:40:58.2322175Z",

	            "FinishedAt": "2021-12-31T11:43:34.3564494Z"

	        },

	        "Image": "sha256:64d09634c60d2a75596bc705aa84bdc41f76fe47c5d9ee362550bffbdc256979",

	        "ResolvConfPath": "/var/lib/docker/containers/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106/hostname",

	        "HostsPath": "/var/lib/docker/containers/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106/hosts",

	        "LogPath": "/var/lib/docker/containers/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106/11225af84302fb06c52d4b95ec93a6e9132162654a6062e53a957b7b61a5e106-json.log",

	        "Name": "/default-k8s-different-port-20211231113947-1576",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "default-k8s-different-port-20211231113947-1576:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "default-k8s-different-port-20211231113947-1576",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8444/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2306867200,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                {

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

	                }

	            ],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 2306867200,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/360bd4e7ed2df2c7db9344ab61b1d38661276023bee06c9c05b655772766af89-init/diff:/var/lib/docker/overlay2/236e34868c6bd5ecc10a009188d3dd414c10322ed61f0f8bd2f0cc6afe31d4a2/diff:/var/lib/docker/overlay2/4f26d83e8780f057af23a45796afe2feeb4c6225d04f3e75d86d76ce33e6eeb7/diff:/var/lib/docker/overlay2/1aa2f7df6f61654ba127b3d7ca8e4c7c9faa9ea133a905aee86c5c729b50580e/diff:/var/lib/docker/overlay2/810f58a572d447e357f0e37fcb6e434743ec2c41f1a828b80ea35481ad056b01/diff:/var/lib/docker/overlay2/0f8aaf037fa7c7675cf275f7d2ec3ea76e658acf5a3dab8397689e8f0f123d26/diff:/var/lib/docker/overlay2/be7ae9f76a1638260aab5f1fa7ff3040af697c9a44380f0cc9d6b9f8e13fc3d0/diff:/var/lib/docker/overlay2/ef02c9f68049a2b4bbb3c853a879f858f696367e0e4a0cd3c8f8a560cf64f559/diff:/var/lib/docker/overlay2/35131ade500d28bbea06e314019475aaefc896faf010312fe4a992789b633265/diff:/var/lib/docker/overlay2/8d9649b172e37864a9f036c4de74b67ea5b01978cffc6a9362049d5ea5d6f55d/diff:/var/lib/docker/overlay2/52868f

77169cdf9bc78bcde8ac7ec95f1a8185a6302edb584dbf9a6360daf03a/diff:/var/lib/docker/overlay2/f8c18464f7aef662c8d4ad84d2451d43835e5f4569a4d2b9f30ad97322903d11/diff:/var/lib/docker/overlay2/0101fb0a80bf47a589e85bb95fd060770df32c7a11dbd8a7dcfef4d9d01f8af2/diff:/var/lib/docker/overlay2/07d0477dc6604496cacf7ed9c358a06fe7d29546c33411fecdaf0ecaa2a9a0ef/diff:/var/lib/docker/overlay2/3f31c6e0e5aac9e858d82dd03ebea66448458f5a927add3f654a304d2c37e502/diff:/var/lib/docker/overlay2/d7ed3b53a0a390071295a19edc1e7d6c00a99dfe061348b28a62f8b9a82318d0/diff:/var/lib/docker/overlay2/3b636a10aa41811f93fe647f4a2254548b80bdeb098c8533b22c4d79d53fcdf0/diff:/var/lib/docker/overlay2/ce837cfcf557adff25b0b4b5f4d6f01e0cf5a1b8bb23ee431d224975cacbe2b0/diff:/var/lib/docker/overlay2/3605fc7a2584009be0a2860c72bef0b598b9bc1f266a398074b7c8a7123333b1/diff:/var/lib/docker/overlay2/05a27701432d46329015577bf385d007c4190625712f8101bb39d9a5744fae1b/diff:/var/lib/docker/overlay2/c25e37734ac3910f77446ef67a386f29de76d35b911b15e745ab7622def0e089/diff:/var/lib/d

ocker/overlay2/a8e782b00e5454fb7d4ededfc9896090aac72e1b0b4c00e43cc9e0bdcf4d2906/diff:/var/lib/docker/overlay2/44c82f3c0e578428d3d9bd874ec44bdd533b0d6845072a4aac19be4720565273/diff:/var/lib/docker/overlay2/14d59fa1343c7e69048f262f4f3f304832c41b33f9f6b5d17a01d67b6c488996/diff:/var/lib/docker/overlay2/15c980de9f5f13135282866b74e142b0c02c48a68d5b570fdb352734d154c43c/diff:/var/lib/docker/overlay2/82368a0688767ffd3b7eb2fd7f8cf27704e4ae4f7ecbb8b8b73f437e928c0db7/diff:/var/lib/docker/overlay2/e976758fe64d0a07d050f840cfff6da24646e500eb0758ad525eec4402c332fb/diff:/var/lib/docker/overlay2/74148e6df6795f39b3025653e1114d8d16999f340f4ace621d5d37e82a3698fe/diff:/var/lib/docker/overlay2/05e29b3eb2babc45b9101583a4b8dc9c219237c4297f0678b648a934cd2cf604/diff:/var/lib/docker/overlay2/d7cae5db557577bece8070136b11e87052bce1263acb0b687e90567746b09f61/diff:/var/lib/docker/overlay2/5b1ff4405c06a77b96c7b61fbf1df81004551144d651ae61b632dfc3b269bc76/diff:/var/lib/docker/overlay2/f50ff6635032640d426a42ecb016d73fdb96ba15505a1ae4f01d7cb3315

925fb/diff:/var/lib/docker/overlay2/72f65c380012ae92d0675a1b93218ad4ecd8addccb3371324d814fa248daed27/diff:/var/lib/docker/overlay2/b1c4ea370005cb0ea474c83801a0ba4b376d83bfe171b465e61eeab9fbd46b68/diff:/var/lib/docker/overlay2/182b2273f71a8695b8a041e54bb701488b71028091c701a3271bdf6fd0f2c5f5/diff:/var/lib/docker/overlay2/31812fd31cbde39dd1044b048c3f74540d47fbb1dd15634a350ede4f6725dea5/diff:/var/lib/docker/overlay2/58541d8dc75e6a2ece804245b92e88e76345bdbbdda996fbd757eb2290e3e609/diff:/var/lib/docker/overlay2/207a2c171a9595e78850f4fe19c5e78e337c2201f45a4cebc01f869ca7eecf54/diff:/var/lib/docker/overlay2/93569597c37885046de0762af7ba9d6379d54b5533be30cc27f514859f28f7ba/diff:/var/lib/docker/overlay2/57f04579d4692224f2cabd08068218468a37e48174920084405ce9ae88d5d7a7/diff:/var/lib/docker/overlay2/db96b3bbab3bd95dcee0936a5ab318b82dcc941cc09c1fd201e21d97dd5d7617/diff:/var/lib/docker/overlay2/0560b92e88427b3710f730d81a8d910fa8c7feee2a4273c4abb5c51364213d07/diff:/var/lib/docker/overlay2/4e3f380bd40064fcfb56a83f831a38ef53e4ea

bbf36f7661d063e55ccf2972c0/diff:/var/lib/docker/overlay2/65534d10a48ed16cb8b24cc817d40ad1c80c0bbb261a2b966fb4e1bac0f2b524/diff:/var/lib/docker/overlay2/799e74a4ab0cf4fb970c0d6f14af7e37410bf1168fcb40d81c85c773f406f235/diff",

	                "MergedDir": "/var/lib/docker/overlay2/360bd4e7ed2df2c7db9344ab61b1d38661276023bee06c9c05b655772766af89/merged",

	                "UpperDir": "/var/lib/docker/overlay2/360bd4e7ed2df2c7db9344ab61b1d38661276023bee06c9c05b655772766af89/diff",

	                "WorkDir": "/var/lib/docker/overlay2/360bd4e7ed2df2c7db9344ab61b1d38661276023bee06c9c05b655772766af89/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "default-k8s-different-port-20211231113947-1576",

	                "Source": "/var/lib/docker/volumes/default-k8s-different-port-20211231113947-1576/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "default-k8s-different-port-20211231113947-1576",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8444/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.28-1640212998-13227@sha256:be897edc9ed473a9678010f390a0092f488f6a1c30865f571c3b6388f9f56f9b",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "default-k8s-different-port-20211231113947-1576",

	                "name.minikube.sigs.k8s.io": "default-k8s-different-port-20211231113947-1576",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "aaf3b09ad27e886c553df33c0beee25d2ce62859bd45339fbcf09556183a5f3a",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {},

	            "SandboxKey": "/var/run/docker/netns/aaf3b09ad27e",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "default-k8s-different-port-20211231113947-1576": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.67.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "11225af84302",

	                        "default-k8s-different-port-20211231113947-1576"

	                    ],

	                    "NetworkID": "28f2b467e2029f6c69bcf00096c983d688568193b5931ffd81919f4d2577d2d5",

	                    "EndpointID": "",

	                    "Gateway": "",

	                    "IPAddress": "",

	                    "IPPrefixLen": 0,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p default-k8s-different-port-20211231113947-1576 -n default-k8s-different-port-20211231113947-1576

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.Host}} -p default-k8s-different-port-20211231113947-1576 -n default-k8s-different-port-20211231113947-1576: exit status 7 (3.3039049s)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "default-k8s-different-port-20211231113947-1576" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestStartStop/group/default-k8s-different-port/serial/SecondStart (66.72s)