=== RUN TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade
=== CONT TestMissingContainerUpgrade
version_upgrade_test.go:309: (dbg) Run: /tmp/minikube-v1.26.0.3547799178 start -p missing-upgrade-047898 --memory=2200 --driver=docker --container-runtime=docker
version_upgrade_test.go:309: (dbg) Done: /tmp/minikube-v1.26.0.3547799178 start -p missing-upgrade-047898 --memory=2200 --driver=docker --container-runtime=docker: (1m25.40347506s)
version_upgrade_test.go:318: (dbg) Run: docker stop missing-upgrade-047898
version_upgrade_test.go:318: (dbg) Done: docker stop missing-upgrade-047898: (10.377176517s)
version_upgrade_test.go:323: (dbg) Run: docker rm missing-upgrade-047898
version_upgrade_test.go:329: (dbg) Run: out/minikube-linux-amd64 start -p missing-upgrade-047898 --memory=2200 --alsologtostderr -v=1 --driver=docker --container-runtime=docker
version_upgrade_test.go:329: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p missing-upgrade-047898 --memory=2200 --alsologtostderr -v=1 --driver=docker --container-runtime=docker: exit status 90 (35.4727763s)
-- stdout --
* [missing-upgrade-047898] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18634
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18634-7363/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18634-7363/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.29.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.29.3
* Using the docker driver based on existing profile
* Starting "missing-upgrade-047898" primary control-plane node in "missing-upgrade-047898" cluster
* Pulling base image v0.0.43-1713176859-18634 ...
* docker "missing-upgrade-047898" container is missing, will recreate.
* Creating docker container (CPUs=2, Memory=2200MB) ...
-- /stdout --
** stderr **
I0415 18:17:18.544253 302398 out.go:291] Setting OutFile to fd 1 ...
I0415 18:17:18.544553 302398 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0415 18:17:18.544564 302398 out.go:304] Setting ErrFile to fd 2...
I0415 18:17:18.544570 302398 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0415 18:17:18.544783 302398 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18634-7363/.minikube/bin
I0415 18:17:18.545329 302398 out.go:298] Setting JSON to false
	I0415 18:17:18.546720  302398 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":3585,"bootTime":1713201454,"procs":321,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
                                                
                                                I0415 18:17:18.546787 302398 start.go:139] virtualization: kvm guest
I0415 18:17:18.550200 302398 out.go:177] * [missing-upgrade-047898] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)
I0415 18:17:18.551872 302398 out.go:177] - MINIKUBE_LOCATION=18634
I0415 18:17:18.553042 302398 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0415 18:17:18.551934 302398 notify.go:220] Checking for updates...
I0415 18:17:18.555349 302398 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18634-7363/kubeconfig
I0415 18:17:18.556718 302398 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18634-7363/.minikube
I0415 18:17:18.558015 302398 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0415 18:17:18.559326 302398 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0415 18:17:18.561011 302398 config.go:182] Loaded profile config "missing-upgrade-047898": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.1
I0415 18:17:18.562704 302398 out.go:177] * Kubernetes 1.29.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.29.3
I0415 18:17:18.563933 302398 driver.go:392] Setting default libvirt URI to qemu:///system
I0415 18:17:18.587843 302398 docker.go:122] docker version: linux-26.0.1:Docker Engine - Community
	I0415 18:17:18.587964  302398 cli_runner.go:164] Run: docker system info --format "{{json .}}"
                                                
                                                	I0415 18:17:18.655520  302398 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:49 OomKillDisable:true NGoroutines:73 SystemTime:2024-04-15 18:17:18.643625154 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
                                                
                                                _64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647976448 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-10 Labels:[] ExperimentalBuild:false ServerVersion:26.0.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
                                                
                                                rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
                                                
                                                I0415 18:17:18.655656 302398 docker.go:295] overlay module found
I0415 18:17:18.658361 302398 out.go:177] * Using the docker driver based on existing profile
I0415 18:17:18.659684 302398 start.go:297] selected driver: docker
	I0415 18:17:18.659707  302398 start.go:901] validating driver "docker" against &{Name:missing-upgrade-047898 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:missing-upgrade-047898 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
                                                
                                                ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: Socke
                                                
                                                tVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I0415 18:17:18.659832  302398 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
                                                
                                                	I0415 18:17:18.660910  302398 cli_runner.go:164] Run: docker system info --format "{{json .}}"
                                                
                                                	I0415 18:17:18.718585  302398 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:49 OomKillDisable:true NGoroutines:73 SystemTime:2024-04-15 18:17:18.708839767 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
                                                
                                                _64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647976448 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-10 Labels:[] ExperimentalBuild:false ServerVersion:26.0.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
                                                
                                                rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
                                                
                                                I0415 18:17:18.719313 302398 cni.go:84] Creating CNI manager for ""
I0415 18:17:18.719352 302398 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0415 18:17:18.719475 302398 start.go:340] cluster config:
	{Name:missing-upgrade-047898 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:missing-upgrade-047898 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker C
                                                
                                                RISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: Au
                                                
                                                toPauseInterval:0s}
I0415 18:17:18.721840 302398 out.go:177] * Starting "missing-upgrade-047898" primary control-plane node in "missing-upgrade-047898" cluster
I0415 18:17:18.723074 302398 cache.go:121] Beginning downloading kic base image for docker with docker
I0415 18:17:18.724340 302398 out.go:177] * Pulling base image v0.0.43-1713176859-18634 ...
I0415 18:17:18.725470 302398 preload.go:132] Checking if preload exists for k8s version v1.24.1 and runtime docker
I0415 18:17:18.725506 302398 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18634-7363/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4
I0415 18:17:18.725512 302398 cache.go:56] Caching tarball of preloaded images
I0415 18:17:18.725559 302398 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 in local docker daemon
I0415 18:17:18.725578 302398 preload.go:173] Found /home/jenkins/minikube-integration/18634-7363/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0415 18:17:18.725588 302398 cache.go:59] Finished verifying existence of preloaded tar for v1.24.1 on docker
I0415 18:17:18.725705 302398 profile.go:143] Saving config to /home/jenkins/minikube-integration/18634-7363/.minikube/profiles/missing-upgrade-047898/config.json ...
I0415 18:17:18.742657 302398 image.go:83] Found gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 in local docker daemon, skipping pull
I0415 18:17:18.742683 302398 cache.go:144] gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 exists in daemon, skipping load
I0415 18:17:18.742709 302398 cache.go:194] Successfully downloaded all kic artifacts
	I0415 18:17:18.742741  302398 start.go:360] acquireMachinesLock for missing-upgrade-047898: {Name:mk47315c7b04eb2086b66285e9206589536ee8f9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
                                                
                                                I0415 18:17:18.742828 302398 start.go:364] duration metric: took 54.192µs to acquireMachinesLock for "missing-upgrade-047898"
I0415 18:17:18.742850 302398 start.go:96] Skipping create...Using existing machine configuration
I0415 18:17:18.742860 302398 fix.go:54] fixHost starting:
	I0415 18:17:18.743083  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                	W0415 18:17:18.758388  302398 cli_runner.go:211] docker container inspect missing-upgrade-047898 --format={{.State.Status}} returned with exit code 1
                                                
                                                	I0415 18:17:18.758465  302398 fix.go:112] recreateIfNeeded on missing-upgrade-047898: state= err=unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
I0415 18:17:18.758487 302398 fix.go:117] machineExists: false. err=machine does not exist
I0415 18:17:18.760031 302398 out.go:177] * docker "missing-upgrade-047898" container is missing, will recreate.
I0415 18:17:18.761300 302398 delete.go:124] DEMOLISHING missing-upgrade-047898 ...
	I0415 18:17:18.761374  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                	W0415 18:17:18.778053  302398 cli_runner.go:211] docker container inspect missing-upgrade-047898 --format={{.State.Status}} returned with exit code 1
                                                
                                                	W0415 18:17:18.778129  302398 stop.go:83] unable to get state: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
	I0415 18:17:18.778149  302398 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
	I0415 18:17:18.778639  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                	W0415 18:17:18.793097  302398 cli_runner.go:211] docker container inspect missing-upgrade-047898 --format={{.State.Status}} returned with exit code 1
                                                
                                                	I0415 18:17:18.793177  302398 delete.go:82] Unable to get host status for missing-upgrade-047898, assuming it has already been deleted: state: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
	I0415 18:17:18.793246  302398 cli_runner.go:164] Run: docker container inspect -f {{.Id}} missing-upgrade-047898
                                                
                                                	W0415 18:17:18.812103  302398 cli_runner.go:211] docker container inspect -f {{.Id}} missing-upgrade-047898 returned with exit code 1
                                                
                                                I0415 18:17:18.812141 302398 kic.go:371] could not find the container missing-upgrade-047898 to remove it. will try anyways
	I0415 18:17:18.812186  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                	W0415 18:17:18.827171  302398 cli_runner.go:211] docker container inspect missing-upgrade-047898 --format={{.State.Status}} returned with exit code 1
                                                
                                                	W0415 18:17:18.827257  302398 oci.go:84] error getting container status, will try to delete anyways: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
I0415 18:17:18.827311 302398 cli_runner.go:164] Run: docker exec --privileged -t missing-upgrade-047898 /bin/bash -c "sudo init 0"
W0415 18:17:18.844591 302398 cli_runner.go:211] docker exec --privileged -t missing-upgrade-047898 /bin/bash -c "sudo init 0" returned with exit code 1
I0415 18:17:18.844618 302398 oci.go:650] error shutdown missing-upgrade-047898: docker exec --privileged -t missing-upgrade-047898 /bin/bash -c "sudo init 0": exit status 1
stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
	I0415 18:17:19.844820  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                	W0415 18:17:19.864538  302398 cli_runner.go:211] docker container inspect missing-upgrade-047898 --format={{.State.Status}} returned with exit code 1
                                                
                                                	I0415 18:17:19.864617  302398 oci.go:662] temporary error verifying shutdown: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
I0415 18:17:19.864635 302398 oci.go:664] temporary error: container missing-upgrade-047898 status is but expect it to be exited
	I0415 18:17:19.864698  302398 retry.go:31] will retry after 461.052706ms: couldn't verify container is exited. %v: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
	I0415 18:17:20.326354  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                	W0415 18:17:20.342303  302398 cli_runner.go:211] docker container inspect missing-upgrade-047898 --format={{.State.Status}} returned with exit code 1
                                                
                                                	I0415 18:17:20.342369  302398 oci.go:662] temporary error verifying shutdown: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
I0415 18:17:20.342389 302398 oci.go:664] temporary error: container missing-upgrade-047898 status is but expect it to be exited
	I0415 18:17:20.342418  302398 retry.go:31] will retry after 399.233085ms: couldn't verify container is exited. %v: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
	I0415 18:17:20.741984  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                	W0415 18:17:20.762511  302398 cli_runner.go:211] docker container inspect missing-upgrade-047898 --format={{.State.Status}} returned with exit code 1
                                                
                                                	I0415 18:17:20.762580  302398 oci.go:662] temporary error verifying shutdown: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
I0415 18:17:20.762595 302398 oci.go:664] temporary error: container missing-upgrade-047898 status is but expect it to be exited
	I0415 18:17:20.762640  302398 retry.go:31] will retry after 1.666023888s: couldn't verify container is exited. %v: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
	I0415 18:17:22.430190  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                	W0415 18:17:22.446605  302398 cli_runner.go:211] docker container inspect missing-upgrade-047898 --format={{.State.Status}} returned with exit code 1
                                                
                                                	I0415 18:17:22.446661  302398 oci.go:662] temporary error verifying shutdown: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
I0415 18:17:22.446671 302398 oci.go:664] temporary error: container missing-upgrade-047898 status is but expect it to be exited
	I0415 18:17:22.446701  302398 retry.go:31] will retry after 2.078295353s: couldn't verify container is exited. %v: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
	I0415 18:17:24.525993  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                	W0415 18:17:24.540244  302398 cli_runner.go:211] docker container inspect missing-upgrade-047898 --format={{.State.Status}} returned with exit code 1
                                                
                                                	I0415 18:17:24.540309  302398 oci.go:662] temporary error verifying shutdown: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
I0415 18:17:24.540321 302398 oci.go:664] temporary error: container missing-upgrade-047898 status is but expect it to be exited
	I0415 18:17:24.540346  302398 retry.go:31] will retry after 2.698400208s: couldn't verify container is exited. %v: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
	I0415 18:17:27.240330  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                	W0415 18:17:27.254377  302398 cli_runner.go:211] docker container inspect missing-upgrade-047898 --format={{.State.Status}} returned with exit code 1
                                                
                                                	I0415 18:17:27.254449  302398 oci.go:662] temporary error verifying shutdown: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
I0415 18:17:27.254458 302398 oci.go:664] temporary error: container missing-upgrade-047898 status is but expect it to be exited
	I0415 18:17:27.254486  302398 retry.go:31] will retry after 3.458395718s: couldn't verify container is exited. %v: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
	I0415 18:17:30.713570  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                	W0415 18:17:30.733489  302398 cli_runner.go:211] docker container inspect missing-upgrade-047898 --format={{.State.Status}} returned with exit code 1
                                                
                                                	I0415 18:17:30.733572  302398 oci.go:662] temporary error verifying shutdown: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
I0415 18:17:30.733583 302398 oci.go:664] temporary error: container missing-upgrade-047898 status is but expect it to be exited
	I0415 18:17:30.733613  302398 retry.go:31] will retry after 8.494200967s: couldn't verify container is exited. %v: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
	I0415 18:17:39.228032  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                	W0415 18:17:39.241265  302398 cli_runner.go:211] docker container inspect missing-upgrade-047898 --format={{.State.Status}} returned with exit code 1
                                                
                                                	I0415 18:17:39.241334  302398 oci.go:662] temporary error verifying shutdown: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
I0415 18:17:39.241347 302398 oci.go:664] temporary error: container missing-upgrade-047898 status is but expect it to be exited
	I0415 18:17:39.241407  302398 oci.go:88] couldn't shut down missing-upgrade-047898 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "missing-upgrade-047898": docker container inspect missing-upgrade-047898 --format={{.State.Status}}: exit status 1
                                                
                                                stdout:
stderr:
Error response from daemon: No such container: missing-upgrade-047898
I0415 18:17:39.241466 302398 cli_runner.go:164] Run: docker rm -f -v missing-upgrade-047898
	I0415 18:17:39.256363  302398 cli_runner.go:164] Run: docker container inspect -f {{.Id}} missing-upgrade-047898
                                                
                                                	W0415 18:17:39.273334  302398 cli_runner.go:211] docker container inspect -f {{.Id}} missing-upgrade-047898 returned with exit code 1
                                                
                                                	I0415 18:17:39.273434  302398 cli_runner.go:164] Run: docker network inspect missing-upgrade-047898 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
                                                
                                                I0415 18:17:39.290441 302398 cli_runner.go:164] Run: docker network rm missing-upgrade-047898
I0415 18:17:39.398449 302398 fix.go:124] Sleeping 1 second for extra luck!
I0415 18:17:40.399313 302398 start.go:125] createHost starting for "" (driver="docker")
I0415 18:17:40.401740 302398 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0415 18:17:40.401862 302398 start.go:159] libmachine.API.Create for "missing-upgrade-047898" (driver="docker")
I0415 18:17:40.401887 302398 client.go:168] LocalClient.Create starting
I0415 18:17:40.402084 302398 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem
I0415 18:17:40.402131 302398 main.go:141] libmachine: Decoding PEM data...
I0415 18:17:40.402154 302398 main.go:141] libmachine: Parsing certificate...
I0415 18:17:40.402215 302398 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem
I0415 18:17:40.402239 302398 main.go:141] libmachine: Decoding PEM data...
I0415 18:17:40.402256 302398 main.go:141] libmachine: Parsing certificate...
	I0415 18:17:40.402475  302398 cli_runner.go:164] Run: docker network inspect missing-upgrade-047898 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
                                                
                                                	W0415 18:17:40.416870  302398 cli_runner.go:211] docker network inspect missing-upgrade-047898 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
                                                
                                                I0415 18:17:40.416940 302398 network_create.go:281] running [docker network inspect missing-upgrade-047898] to gather additional debugging logs...
I0415 18:17:40.416958 302398 cli_runner.go:164] Run: docker network inspect missing-upgrade-047898
W0415 18:17:40.432348 302398 cli_runner.go:211] docker network inspect missing-upgrade-047898 returned with exit code 1
I0415 18:17:40.432376 302398 network_create.go:284] error running [docker network inspect missing-upgrade-047898]: docker network inspect missing-upgrade-047898: exit status 1
stdout:
[]
stderr:
Error response from daemon: network missing-upgrade-047898 not found
I0415 18:17:40.432391 302398 network_create.go:286] output of [docker network inspect missing-upgrade-047898]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network missing-upgrade-047898 not found
** /stderr **
	I0415 18:17:40.432512  302398 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
                                                
                                                	I0415 18:17:40.449208  302398 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-6760c7135419 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:63:de:de:fa} reservation:<nil>}
                                                
                                                	I0415 18:17:40.449976  302398 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-ee0168a20982 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:18:0e:e7:8c} reservation:<nil>}
                                                
                                                	I0415 18:17:40.450758  302398 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-38de591302a2 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:2e:f3:12:62} reservation:<nil>}
                                                
                                                	I0415 18:17:40.451339  302398 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-a60028b212fd IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:54:37:c4:53} reservation:<nil>}
                                                
                                                	I0415 18:17:40.452010  302398 network.go:211] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName:br-e3b283515f32 IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:02:42:0b:28:56:90} reservation:<nil>}
                                                
                                                	I0415 18:17:40.452519  302398 network.go:211] skipping subnet 192.168.94.0/24 that is taken: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 IsPrivate:true Interface:{IfaceName:br-99ba69633e2e IfaceIPv4:192.168.94.1 IfaceMTU:1500 IfaceMAC:02:42:78:59:2f:70} reservation:<nil>}
                                                
                                                	I0415 18:17:40.453258  302398 network.go:206] using free private subnet 192.168.103.0/24: &{IP:192.168.103.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.103.0/24 Gateway:192.168.103.1 ClientMin:192.168.103.2 ClientMax:192.168.103.254 Broadcast:192.168.103.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc002250030}
                                                
                                                I0415 18:17:40.453279 302398 network_create.go:124] attempt to create docker network missing-upgrade-047898 192.168.103.0/24 with gateway 192.168.103.1 and MTU of 1500 ...
I0415 18:17:40.453323 302398 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.103.0/24 --gateway=192.168.103.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=missing-upgrade-047898 missing-upgrade-047898
I0415 18:17:40.508909 302398 network_create.go:108] docker network missing-upgrade-047898 192.168.103.0/24 created
I0415 18:17:40.508941 302398 kic.go:121] calculated static IP "192.168.103.2" for the "missing-upgrade-047898" container
	I0415 18:17:40.509017  302398 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
                                                
                                                I0415 18:17:40.525280 302398 cli_runner.go:164] Run: docker volume create missing-upgrade-047898 --label name.minikube.sigs.k8s.io=missing-upgrade-047898 --label created_by.minikube.sigs.k8s.io=true
I0415 18:17:40.539802 302398 oci.go:103] Successfully created a docker volume missing-upgrade-047898
I0415 18:17:40.539876 302398 cli_runner.go:164] Run: docker run --rm --name missing-upgrade-047898-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-047898 --entrypoint /usr/bin/test -v missing-upgrade-047898:/var gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 -d /var/lib
I0415 18:17:40.964030 302398 oci.go:107] Successfully prepared a docker volume missing-upgrade-047898
I0415 18:17:40.964064 302398 preload.go:132] Checking if preload exists for k8s version v1.24.1 and runtime docker
I0415 18:17:40.964090 302398 kic.go:194] Starting extracting preloaded images to volume ...
I0415 18:17:40.964170 302398 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18634-7363/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-047898:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 -I lz4 -xf /preloaded.tar -C /extractDir
I0415 18:17:46.800271 302398 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18634-7363/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-047898:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 -I lz4 -xf /preloaded.tar -C /extractDir: (5.836027996s)
I0415 18:17:46.800306 302398 kic.go:203] duration metric: took 5.836212536s to extract preloaded images to volume ...
W0415 18:17:46.800446 302398 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0415 18:17:46.800558  302398 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
                                                
                                                I0415 18:17:46.860082 302398 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname missing-upgrade-047898 --name missing-upgrade-047898 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-047898 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=missing-upgrade-047898 --network missing-upgrade-047898 --ip 192.168.103.2 --volume missing-upgrade-047898:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95
	I0415 18:17:47.515180  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Running}}
                                                
                                                	I0415 18:17:47.536557  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                I0415 18:17:47.556658 302398 cli_runner.go:164] Run: docker exec missing-upgrade-047898 stat /var/lib/dpkg/alternatives/iptables
I0415 18:17:47.611118 302398 oci.go:144] the created container "missing-upgrade-047898" has a running status.
I0415 18:17:47.611156 302398 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa...
I0415 18:17:48.018550 302398 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0415 18:17:48.043989  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                I0415 18:17:48.062052 302398 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0415 18:17:48.062077 302398 kic_runner.go:114] Args: [docker exec --privileged missing-upgrade-047898 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0415 18:17:48.109956  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                I0415 18:17:48.127033 302398 machine.go:94] provisionDockerMachine start ...
	I0415 18:17:48.127137  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:48.143551 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:48.143828  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:48.143848 302398 main.go:141] libmachine: About to run SSH command:
hostname
I0415 18:17:48.322007 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-047898
I0415 18:17:48.322042 302398 ubuntu.go:169] provisioning hostname "missing-upgrade-047898"
	I0415 18:17:48.322113  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:48.339891 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:48.340089  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:48.340104 302398 main.go:141] libmachine: About to run SSH command:
sudo hostname missing-upgrade-047898 && echo "missing-upgrade-047898" | sudo tee /etc/hostname
I0415 18:17:48.511278 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-047898
	I0415 18:17:48.511373  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:48.528793 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:48.528985  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:48.529011 302398 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smissing-upgrade-047898' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-047898/g' /etc/hosts;
else
echo '127.0.1.1 missing-upgrade-047898' | sudo tee -a /etc/hosts;
fi
fi
I0415 18:17:48.654615 302398 main.go:141] libmachine: SSH cmd err, output: <nil>:
	I0415 18:17:48.654644  302398 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18634-7363/.minikube CaCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18634-7363/.minikube}
                                                
                                                I0415 18:17:48.654685 302398 ubuntu.go:177] setting up certificates
I0415 18:17:48.654697 302398 provision.go:84] configureAuth start
	I0415 18:17:48.654772  302398 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-047898
                                                
                                                I0415 18:17:48.672302 302398 provision.go:143] copyHostCerts
I0415 18:17:48.672385 302398 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem, removing ...
I0415 18:17:48.672401 302398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem
I0415 18:17:48.687091 302398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem (1679 bytes)
I0415 18:17:48.687247 302398 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem, removing ...
I0415 18:17:48.687262 302398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem
I0415 18:17:48.687310 302398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem (1078 bytes)
I0415 18:17:48.687403 302398 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem, removing ...
I0415 18:17:48.687414 302398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem
I0415 18:17:48.687446 302398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem (1123 bytes)
I0415 18:17:48.687573 302398 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-047898 san=[127.0.0.1 192.168.103.2 localhost minikube missing-upgrade-047898]
I0415 18:17:48.790840 302398 provision.go:177] copyRemoteCerts
I0415 18:17:48.790922 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0415 18:17:48.791000  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:48.807073  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                I0415 18:17:48.894122 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0415 18:17:48.949894 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0415 18:17:48.972019 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0415 18:17:48.993434 302398 provision.go:87] duration metric: took 338.707703ms to configureAuth
I0415 18:17:48.993473 302398 ubuntu.go:193] setting minikube options for container-runtime
I0415 18:17:48.993722 302398 config.go:182] Loaded profile config "missing-upgrade-047898": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0415 18:17:48.993796  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:49.011898 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:49.012163  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:49.012197 302398 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0415 18:17:49.143384 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0415 18:17:49.143418 302398 ubuntu.go:71] root file system type: overlay
I0415 18:17:49.143534 302398 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
	I0415 18:17:49.143597  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:49.161680 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:49.161948  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:49.162056 302398 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0415 18:17:49.337493 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
	I0415 18:17:49.337614  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:49.357793 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:49.358081  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:49.358120 302398 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
                                                
                                                I0415 18:17:51.271398 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-06-06 23:01:03.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2024-04-15 18:17:49.333299778 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0415 18:17:51.271440 302398 machine.go:97] duration metric: took 3.144377385s to provisionDockerMachine
I0415 18:17:51.271460 302398 client.go:171] duration metric: took 10.869565106s to LocalClient.Create
I0415 18:17:51.271478 302398 start.go:167] duration metric: took 10.869614646s to libmachine.API.Create "missing-upgrade-047898"
I0415 18:17:51.271493 302398 start.go:293] postStartSetup for "missing-upgrade-047898" (driver="docker")
I0415 18:17:51.271509 302398 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0415 18:17:51.271575 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0415 18:17:51.271633  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:51.290651  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                I0415 18:17:51.382297 302398 ssh_runner.go:195] Run: cat /etc/os-release
I0415 18:17:51.385171 302398 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0415 18:17:51.385201 302398 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0415 18:17:51.385215 302398 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0415 18:17:51.385223 302398 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0415 18:17:51.385234 302398 filesync.go:126] Scanning /home/jenkins/minikube-integration/18634-7363/.minikube/addons for local assets ...
I0415 18:17:51.385289 302398 filesync.go:126] Scanning /home/jenkins/minikube-integration/18634-7363/.minikube/files for local assets ...
I0415 18:17:51.385380 302398 filesync.go:149] local asset: /home/jenkins/minikube-integration/18634-7363/.minikube/files/etc/ssl/certs/142912.pem -> 142912.pem in /etc/ssl/certs
I0415 18:17:51.385497 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0415 18:17:51.393018 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/files/etc/ssl/certs/142912.pem --> /etc/ssl/certs/142912.pem (1708 bytes)
I0415 18:17:51.412102 302398 start.go:296] duration metric: took 140.589799ms for postStartSetup
	I0415 18:17:51.412500  302398 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-047898
                                                
                                                I0415 18:17:51.429808 302398 profile.go:143] Saving config to /home/jenkins/minikube-integration/18634-7363/.minikube/profiles/missing-upgrade-047898/config.json ...
	I0415 18:17:51.430039  302398 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
                                                
                                                	I0415 18:17:51.430082  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:51.445760  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                	I0415 18:17:51.568146  302398 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
                                                
                                                I0415 18:17:51.574859 302398 start.go:128] duration metric: took 11.175505883s to createHost
	I0415 18:17:51.574951  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                W0415 18:17:51.593832 302398 fix.go:138] unexpected machine state, will restart: <nil>
I0415 18:17:51.593875 302398 machine.go:94] provisionDockerMachine start ...
	I0415 18:17:51.593949  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:51.612011 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:51.612224  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:51.612238 302398 main.go:141] libmachine: About to run SSH command:
hostname
I0415 18:17:51.737987 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-047898
I0415 18:17:51.738019 302398 ubuntu.go:169] provisioning hostname "missing-upgrade-047898"
	I0415 18:17:51.738105  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:51.758846 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:51.759077  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:51.759094 302398 main.go:141] libmachine: About to run SSH command:
sudo hostname missing-upgrade-047898 && echo "missing-upgrade-047898" | sudo tee /etc/hostname
I0415 18:17:51.901497 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-047898
	I0415 18:17:51.901587  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:51.922468 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:51.922718  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:51.922742 302398 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smissing-upgrade-047898' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-047898/g' /etc/hosts;
else
echo '127.0.1.1 missing-upgrade-047898' | sudo tee -a /etc/hosts;
fi
fi
I0415 18:17:52.050589 302398 main.go:141] libmachine: SSH cmd err, output: <nil>:
	I0415 18:17:52.050638  302398 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18634-7363/.minikube CaCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18634-7363/.minikube}
                                                
                                                I0415 18:17:52.050670 302398 ubuntu.go:177] setting up certificates
I0415 18:17:52.050682 302398 provision.go:84] configureAuth start
	I0415 18:17:52.050729  302398 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-047898
                                                
                                                I0415 18:17:52.068356 302398 provision.go:143] copyHostCerts
I0415 18:17:52.068426 302398 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem, removing ...
I0415 18:17:52.068442 302398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem
I0415 18:17:52.068516 302398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem (1078 bytes)
I0415 18:17:52.068631 302398 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem, removing ...
I0415 18:17:52.068642 302398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem
I0415 18:17:52.068684 302398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem (1123 bytes)
I0415 18:17:52.068777 302398 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem, removing ...
I0415 18:17:52.068791 302398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem
I0415 18:17:52.068835 302398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem (1679 bytes)
I0415 18:17:52.068923 302398 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-047898 san=[127.0.0.1 192.168.103.2 localhost minikube missing-upgrade-047898]
I0415 18:17:52.210968 302398 provision.go:177] copyRemoteCerts
I0415 18:17:52.211025 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0415 18:17:52.211062  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:52.227485  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                I0415 18:17:52.318199 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0415 18:17:52.335580 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0415 18:17:52.353506 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0415 18:17:52.371578 302398 provision.go:87] duration metric: took 320.884089ms to configureAuth
I0415 18:17:52.371625 302398 ubuntu.go:193] setting minikube options for container-runtime
I0415 18:17:52.371776 302398 config.go:182] Loaded profile config "missing-upgrade-047898": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0415 18:17:52.371824  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:52.388003 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:52.388211  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:52.388228 302398 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0415 18:17:52.511941 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0415 18:17:52.511968 302398 ubuntu.go:71] root file system type: overlay
I0415 18:17:52.512104 302398 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
	I0415 18:17:52.512171  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:52.528775 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:52.529007  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:52.529111 302398 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0415 18:17:52.664049 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
	I0415 18:17:52.664142  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:52.684074 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:52.684304  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:52.684330 302398 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
                                                
                                                I0415 18:17:52.809930 302398 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0415 18:17:52.809960 302398 machine.go:97] duration metric: took 1.21607558s to provisionDockerMachine
I0415 18:17:52.809975 302398 start.go:293] postStartSetup for "missing-upgrade-047898" (driver="docker")
I0415 18:17:52.809990 302398 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0415 18:17:52.810062 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0415 18:17:52.810111  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:52.826914  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                I0415 18:17:52.918570 302398 ssh_runner.go:195] Run: cat /etc/os-release
I0415 18:17:52.921770 302398 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0415 18:17:52.921807 302398 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0415 18:17:52.921823 302398 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0415 18:17:52.921832 302398 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0415 18:17:52.921846 302398 filesync.go:126] Scanning /home/jenkins/minikube-integration/18634-7363/.minikube/addons for local assets ...
I0415 18:17:52.921906 302398 filesync.go:126] Scanning /home/jenkins/minikube-integration/18634-7363/.minikube/files for local assets ...
I0415 18:17:52.921992 302398 filesync.go:149] local asset: /home/jenkins/minikube-integration/18634-7363/.minikube/files/etc/ssl/certs/142912.pem -> 142912.pem in /etc/ssl/certs
I0415 18:17:52.922098 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0415 18:17:52.929136 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/files/etc/ssl/certs/142912.pem --> /etc/ssl/certs/142912.pem (1708 bytes)
I0415 18:17:52.948225 302398 start.go:296] duration metric: took 138.235595ms for postStartSetup
	I0415 18:17:52.948308  302398 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
                                                
                                                	I0415 18:17:52.948360  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:52.966271  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                	I0415 18:17:53.054990  302398 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
                                                
                                                I0415 18:17:53.058996 302398 fix.go:56] duration metric: took 34.316129333s for fixHost
I0415 18:17:53.059027 302398 start.go:83] releasing machines lock for "missing-upgrade-047898", held for 34.316184825s
	I0415 18:17:53.059099  302398 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-047898
                                                
                                                I0415 18:17:53.075031 302398 ssh_runner.go:195] Run: cat /version.json
I0415 18:17:53.075057 302398 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0415 18:17:53.075091  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:53.075145  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:53.099092  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                	I0415 18:17:53.100820  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                W0415 18:17:53.214611 302398 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
stdout:
stderr:
cat: /version.json: No such file or directory
I0415 18:17:53.214696 302398 ssh_runner.go:195] Run: systemctl --version
I0415 18:17:53.218612 302398 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0415 18:17:53.222672  302398 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
                                                
                                                I0415 18:17:53.243453 302398 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0415 18:17:53.243576  302398 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
                                                
                                                	I0415 18:17:53.262636  302398 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
                                                
                                                I0415 18:17:53.270067 302398 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0415 18:17:53.270095 302398 start.go:494] detecting cgroup driver to use...
I0415 18:17:53.270129 302398 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0415 18:17:53.270240 302398 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0415 18:17:53.283322 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.7"|' /etc/containerd/config.toml"
I0415 18:17:53.291408 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0415 18:17:53.299998 302398 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0415 18:17:53.300065 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0415 18:17:53.308625 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0415 18:17:53.316771 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0415 18:17:53.324998 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0415 18:17:53.333387 302398 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0415 18:17:53.341642 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0415 18:17:53.350710 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0415 18:17:53.359767 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0415 18:17:53.368381 302398 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0415 18:17:53.375631 302398 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0415 18:17:53.382724 302398 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0415 18:17:53.468612 302398 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0415 18:17:53.555627 302398 start.go:494] detecting cgroup driver to use...
I0415 18:17:53.555677 302398 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0415 18:17:53.555729 302398 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0415 18:17:53.565760 302398 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0415 18:17:53.565823 302398 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0415 18:17:53.575621 302398 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0415 18:17:53.589543 302398 ssh_runner.go:195] Run: which cri-dockerd
I0415 18:17:53.592461 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0415 18:17:53.599265 302398 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0415 18:17:53.612979 302398 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0415 18:17:53.693466 302398 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0415 18:17:53.769636 302398 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0415 18:17:53.771714 302398 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0415 18:17:53.786055 302398 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0415 18:17:53.875350 302398 ssh_runner.go:195] Run: sudo systemctl restart docker
I0415 18:17:53.934904 302398 ssh_runner.go:195] Run: sudo journalctl --no-pager -u docker
I0415 18:17:53.951530 302398 out.go:177]
W0415 18:17:53.952846 302398 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1
stdout:
stderr:
Job for docker.service failed because the control process exited with error code.
See "systemctl status docker.service" and "journalctl -xe" for details.
sudo journalctl --no-pager -u docker:
-- stdout --
-- Logs begin at Mon 2024-04-15 18:17:47 UTC, end at Mon 2024-04-15 18:17:53 UTC. --
Apr 15 18:17:47 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.962666496Z" level=info msg="Starting up"
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.964316038Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.964343675Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
	Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.964365662Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
                                                
                                                Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.964382930Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.965975424Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.965996199Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
	Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.966028523Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
                                                
                                                Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.966040787Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.497455375Z" level=info msg="[graphdriver] using prior storage driver: overlay2"
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.625137319Z" level=warning msg="Your kernel does not support CPU realtime scheduler"
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.625176492Z" level=warning msg="Your kernel does not support cgroup blkio weight"
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.625184606Z" level=warning msg="Your kernel does not support cgroup blkio weight_device"
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.625419138Z" level=info msg="Loading containers: start."
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.048623948Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.089282581Z" level=info msg="Loading containers: done."
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.345105072Z" level=info msg="Docker daemon" commit=a89b842 graphdriver(s)=overlay2 version=20.10.17
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.345196133Z" level=info msg="Daemon has completed initialization"
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: Started Docker Application Container Engine.
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.365336367Z" level=info msg="API listen on /run/docker.sock"
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: docker.service: Current command vanished from the unit file, execution of the command list won't be resumed.
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: Stopping Docker Application Container Engine...
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.880378835Z" level=info msg="Processing signal 'terminated'"
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.882617095Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.883639774Z" level=info msg="Daemon shutdown complete"
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: docker.service: Succeeded.
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.930702143Z" level=info msg="Starting up"
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.932838345Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.932866036Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
	Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.932888130Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
                                                
                                                Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.932897170Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.934304089Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.934330911Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
	Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.934350661Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
                                                
                                                Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.934367619Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.077000286Z" level=info msg="[graphdriver] using prior storage driver: overlay2"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.083296271Z" level=warning msg="Your kernel does not support CPU realtime scheduler"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.083318632Z" level=warning msg="Your kernel does not support cgroup blkio weight"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.083324418Z" level=warning msg="Your kernel does not support cgroup blkio weight_device"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.083471034Z" level=info msg="Loading containers: start."
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.189383569Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.229403886Z" level=info msg="Loading containers: done."
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.251328914Z" level=info msg="Docker daemon" commit=a89b842 graphdriver(s)=overlay2 version=20.10.17
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.251424991Z" level=info msg="Daemon has completed initialization"
Apr 15 18:17:51 missing-upgrade-047898 systemd[1]: Started Docker Application Container Engine.
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.278370868Z" level=info msg="API listen on [::]:2376"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.283934020Z" level=info msg="API listen on /var/run/docker.sock"
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Stopping Docker Application Container Engine...
Apr 15 18:17:53 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:53.477264601Z" level=info msg="Processing signal 'terminated'"
Apr 15 18:17:53 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:53.479049429Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby
Apr 15 18:17:53 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:53.480333796Z" level=info msg="Daemon shutdown complete"
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Succeeded.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:53 missing-upgrade-047898 dockerd[903]: time="2024-04-15T18:17:53.599703849Z" level=info msg="Starting up"
Apr 15 18:17:53 missing-upgrade-047898 dockerd[903]: failed to create API server: Error reading X509 key pair (cert: "/etc/docker/server.pem", key: "/etc/docker/server-key.pem"): tls: private key does not match public key. Make sure the key is not encrypted.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Failed to start Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Scheduled restart job, restart counter is at 1.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:53 missing-upgrade-047898 dockerd[961]: time="2024-04-15T18:17:53.831506135Z" level=info msg="Starting up"
Apr 15 18:17:53 missing-upgrade-047898 dockerd[961]: failed to create API server: Error reading X509 key pair (cert: "/etc/docker/server.pem", key: "/etc/docker/server-key.pem"): tls: private key does not match public key. Make sure the key is not encrypted.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Failed to start Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:53 missing-upgrade-047898 dockerd[992]: time="2024-04-15T18:17:53.928851683Z" level=info msg="Starting up"
Apr 15 18:17:53 missing-upgrade-047898 dockerd[992]: failed to create API server: Error reading X509 key pair (cert: "/etc/docker/server.pem", key: "/etc/docker/server-key.pem"): tls: private key does not match public key. Make sure the key is not encrypted.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Failed to start Docker Application Container Engine.
-- /stdout --
X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1
stdout:
stderr:
Job for docker.service failed because the control process exited with error code.
See "systemctl status docker.service" and "journalctl -xe" for details.
sudo journalctl --no-pager -u docker:
-- stdout --
-- Logs begin at Mon 2024-04-15 18:17:47 UTC, end at Mon 2024-04-15 18:17:53 UTC. --
Apr 15 18:17:47 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.962666496Z" level=info msg="Starting up"
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.964316038Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.964343675Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
	Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.964365662Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
                                                
                                                Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.964382930Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.965975424Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.965996199Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
	Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.966028523Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
                                                
                                                Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.966040787Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.497455375Z" level=info msg="[graphdriver] using prior storage driver: overlay2"
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.625137319Z" level=warning msg="Your kernel does not support CPU realtime scheduler"
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.625176492Z" level=warning msg="Your kernel does not support cgroup blkio weight"
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.625184606Z" level=warning msg="Your kernel does not support cgroup blkio weight_device"
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.625419138Z" level=info msg="Loading containers: start."
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.048623948Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.089282581Z" level=info msg="Loading containers: done."
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.345105072Z" level=info msg="Docker daemon" commit=a89b842 graphdriver(s)=overlay2 version=20.10.17
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.345196133Z" level=info msg="Daemon has completed initialization"
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: Started Docker Application Container Engine.
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.365336367Z" level=info msg="API listen on /run/docker.sock"
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: docker.service: Current command vanished from the unit file, execution of the command list won't be resumed.
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: Stopping Docker Application Container Engine...
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.880378835Z" level=info msg="Processing signal 'terminated'"
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.882617095Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.883639774Z" level=info msg="Daemon shutdown complete"
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: docker.service: Succeeded.
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.930702143Z" level=info msg="Starting up"
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.932838345Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.932866036Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
	Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.932888130Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
                                                
                                                Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.932897170Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.934304089Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.934330911Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
	Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.934350661Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
                                                
                                                Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.934367619Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.077000286Z" level=info msg="[graphdriver] using prior storage driver: overlay2"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.083296271Z" level=warning msg="Your kernel does not support CPU realtime scheduler"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.083318632Z" level=warning msg="Your kernel does not support cgroup blkio weight"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.083324418Z" level=warning msg="Your kernel does not support cgroup blkio weight_device"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.083471034Z" level=info msg="Loading containers: start."
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.189383569Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.229403886Z" level=info msg="Loading containers: done."
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.251328914Z" level=info msg="Docker daemon" commit=a89b842 graphdriver(s)=overlay2 version=20.10.17
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.251424991Z" level=info msg="Daemon has completed initialization"
Apr 15 18:17:51 missing-upgrade-047898 systemd[1]: Started Docker Application Container Engine.
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.278370868Z" level=info msg="API listen on [::]:2376"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.283934020Z" level=info msg="API listen on /var/run/docker.sock"
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Stopping Docker Application Container Engine...
Apr 15 18:17:53 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:53.477264601Z" level=info msg="Processing signal 'terminated'"
Apr 15 18:17:53 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:53.479049429Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby
Apr 15 18:17:53 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:53.480333796Z" level=info msg="Daemon shutdown complete"
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Succeeded.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:53 missing-upgrade-047898 dockerd[903]: time="2024-04-15T18:17:53.599703849Z" level=info msg="Starting up"
Apr 15 18:17:53 missing-upgrade-047898 dockerd[903]: failed to create API server: Error reading X509 key pair (cert: "/etc/docker/server.pem", key: "/etc/docker/server-key.pem"): tls: private key does not match public key. Make sure the key is not encrypted.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Failed to start Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Scheduled restart job, restart counter is at 1.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:53 missing-upgrade-047898 dockerd[961]: time="2024-04-15T18:17:53.831506135Z" level=info msg="Starting up"
Apr 15 18:17:53 missing-upgrade-047898 dockerd[961]: failed to create API server: Error reading X509 key pair (cert: "/etc/docker/server.pem", key: "/etc/docker/server-key.pem"): tls: private key does not match public key. Make sure the key is not encrypted.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Failed to start Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:53 missing-upgrade-047898 dockerd[992]: time="2024-04-15T18:17:53.928851683Z" level=info msg="Starting up"
Apr 15 18:17:53 missing-upgrade-047898 dockerd[992]: failed to create API server: Error reading X509 key pair (cert: "/etc/docker/server.pem", key: "/etc/docker/server-key.pem"): tls: private key does not match public key. Make sure the key is not encrypted.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Failed to start Docker Application Container Engine.
-- /stdout --
W0415 18:17:53.952888 302398 out.go:239] *
*
W0415 18:17:53.953674 302398 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0415 18:17:53.955724 302398 out.go:177]
** /stderr **
version_upgrade_test.go:331: failed missing container upgrade from v1.26.0. args: out/minikube-linux-amd64 start -p missing-upgrade-047898 --memory=2200 --alsologtostderr -v=1 --driver=docker --container-runtime=docker : exit status 90
version_upgrade_test.go:333: *** TestMissingContainerUpgrade FAILED at 2024-04-15 18:17:54.009137222 +0000 UTC m=+2432.291168934
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestMissingContainerUpgrade]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect missing-upgrade-047898
helpers_test.go:235: (dbg) docker inspect missing-upgrade-047898:
-- stdout --
[
	    {
                                                
                                                "Id": "03798d26ff36812ca3be3b8a8f7bf83ba35d1e9cc0ba4307e12294850ecb828d",
"Created": "2024-04-15T18:17:46.891780851Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
	        "State": {
                                                
                                                "Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 308278,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-04-15T18:17:47.50540831Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:ff7b11088f07b5cc3be2087261aee1627a466228279acbafdb95902df26942d2",
"ResolvConfPath": "/var/lib/docker/containers/03798d26ff36812ca3be3b8a8f7bf83ba35d1e9cc0ba4307e12294850ecb828d/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/03798d26ff36812ca3be3b8a8f7bf83ba35d1e9cc0ba4307e12294850ecb828d/hostname",
"HostsPath": "/var/lib/docker/containers/03798d26ff36812ca3be3b8a8f7bf83ba35d1e9cc0ba4307e12294850ecb828d/hosts",
"LogPath": "/var/lib/docker/containers/03798d26ff36812ca3be3b8a8f7bf83ba35d1e9cc0ba4307e12294850ecb828d/03798d26ff36812ca3be3b8a8f7bf83ba35d1e9cc0ba4307e12294850ecb828d-json.log",
"Name": "/missing-upgrade-047898",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
	        "HostConfig": {
                                                
                                                "Binds": [
"/lib/modules:/lib/modules:ro",
"missing-upgrade-047898:/var"
],
"ContainerIDFile": "",
	            "LogConfig": {
                                                
                                                "Type": "json-file",
	                "Config": {
                                                
                                                "max-size": "100m"
}
},
"NetworkMode": "missing-upgrade-047898",
	            "PortBindings": {
                                                
                                                "22/tcp": [
	                    {
                                                
                                                "HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
	                    {
                                                
                                                "HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
	                    {
                                                
                                                "HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
	                    {
                                                
                                                "HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
	                    {
                                                
                                                "HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
	            "RestartPolicy": {
                                                
                                                "Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
	            "Tmpfs": {
                                                
                                                "/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
	        "GraphDriver": {
                                                
                                                	            "Data": {
                                                
                                                "LowerDir": "/var/lib/docker/overlay2/88502fb0f1edbe9c6517ef01b7ebf6def09a7d8b2ee8059cee5bc153d8988286-init/diff:/var/lib/docker/overlay2/7f3c0b9e3a1c6cb6dd8fce12bed9bf39fe7638289c56ed5ac05ade86a337b224/diff:/var/lib/docker/overlay2/7d2115a39f8c0759d605bfd5bb15d5c3aa9efe41adefb059ca3a0eda543d44e0/diff:/var/lib/docker/overlay2/6fe1b88d718b90a010249619d78a2c327937d29eef237296cb5066c9e4d57d0d/diff:/var/lib/docker/overlay2/aedde2eb51f95bf724199bd0bc6e850c4c33db123f96e2d24fb171d7cb855066/diff:/var/lib/docker/overlay2/c72a53b90735ee2f4938e35c0191bb5e40d30ebec6358eb4b2013086128f5501/diff:/var/lib/docker/overlay2/852a01823a5974ab27b6ea01691eb9e820fa269cb264ef5f72117c5836441fe8/diff:/var/lib/docker/overlay2/a745477e90e000530c4200d2de647c25bc1086d315d3b8570a7005774967fb50/diff:/var/lib/docker/overlay2/3a35d37542666432f846f8a7c5150a16267f0d51fd84bc86827b8db5fd37f38b/diff:/var/lib/docker/overlay2/feb41ec153a6701fbadb3b2f383fd0195732dc5dbd2768b29480fdb040df0dc3/diff:/var/lib/docker/overlay2/1cb394
f2fd0ada78cd48bc4b179a5f8cd256d2b4f53cfbacf60fc94c1b50433a/diff:/var/lib/docker/overlay2/2593ff8cf9c98e08b86a60631b989f316626ac7e1db2477baec183ce455b11ff/diff:/var/lib/docker/overlay2/dbf9fcf4731ef92fced8d078a3d8cd89dcbf7ce7082b0bec035088ef45ab7fb6/diff:/var/lib/docker/overlay2/01f9f0b98b25292d5c96fee6556c87ac69cdb283198d42eae6ee0fb5d0526c8e/diff:/var/lib/docker/overlay2/e0316a0b16915883d4382108eae32f928bec1eb6b5973a94cb34a805a622cffe/diff:/var/lib/docker/overlay2/3a4a2d8eb9992e5bd2da866d951a0ca51a4a30763ae99e80bee2ad17c803c46c/diff:/var/lib/docker/overlay2/0a9197ee26548292e005b96ef07d6c8dbb3d5ddccd3e6c0637365672e4ab7356/diff:/var/lib/docker/overlay2/486da99ac23d1b58e53451c03c91f81fa8ae194fb99c86fc6d2fe04ab844da55/diff:/var/lib/docker/overlay2/ff9f2b38aa62cec497485efeea845046b360a5870c69cdc4c25a91475da67c23/diff:/var/lib/docker/overlay2/01d06fdd72e00843d9ec30bc50b4a00dd62c99bcca6d4bc95ebe92f3b8c2cc67/diff:/var/lib/docker/overlay2/88e17e7865b124620f65932f4e5674f84acc7c8a0a1676eebf6075f9d107cc20/diff:/var/lib/d
ocker/overlay2/b62c5d52347adec2b702410fcba798f0c290730ad243685f450bbe35c649651e/diff:/var/lib/docker/overlay2/a437eef69b322280e34301f90c4d10777e4b86ee388089f52f8598edbbd650f1/diff:/var/lib/docker/overlay2/96635326fca8ec076bdb6a6f5806c9dc57f0f79d80fd0b925885a259650cca8c/diff:/var/lib/docker/overlay2/a5e2c30d25e2e8b9b5872f4c0e52400641e91339ea2cbd53fe0aed4c3b9a9de1/diff:/var/lib/docker/overlay2/5928af38c2654f2ed5cebc922e902894ca2707c483e2393fa30cc47ce086cf21/diff:/var/lib/docker/overlay2/596e8d8103bd0a517debc1c563a2d3dfb438624d97d98d8239bc3c9a9b47db96/diff:/var/lib/docker/overlay2/1dc77cd54a3c317be8f48e86c54f9428028fcf53044a2554be3ec28730e22e1a/diff:/var/lib/docker/overlay2/b7ca0d2de192f744617ed8c795324c832b148142e3969c0bdc0daa73ae11af50/diff:/var/lib/docker/overlay2/69076a0915d3588ef86ab17e0841b7be7cac4d1e76a952a119c18f81018f4841/diff:/var/lib/docker/overlay2/86de91d509e1c04df2e7243dad2f41602ae60318e3c23ddf82c32b77769748e5/diff:/var/lib/docker/overlay2/21c8e144fbd278631c8a012be5949d0e26eb1bc6e735a7a9ece3f16b295
3df60/diff:/var/lib/docker/overlay2/1bdffe9043dc6c510ec08efc5cf37daac8afa152ddcee057414f14f7e19974bf/diff:/var/lib/docker/overlay2/d48375b258a80593e369677453d040024ea57c0a6aa28b77a3e4c16b718080ae/diff:/var/lib/docker/overlay2/e380d8560a6a488b7d0b08974be411bfb1ae86537f8cfd9e088efece74b25c3b/diff:/var/lib/docker/overlay2/ac149d3f1bef6e131ac99a8e56b1988b9ef40cff52defac1b7f323ff61c5c2f0/diff:/var/lib/docker/overlay2/493c59be647e315cc3d5cd01d186dccee3e8865d2a6714e528c2065afa18e992/diff:/var/lib/docker/overlay2/22c9d3249c6f659b42831cf43350a4eb7f13be7f5b87c1653398ff1fa79b24fc/diff:/var/lib/docker/overlay2/d8f75591403ec4528c7082b18ed4045837039a2b75b2f939c5e682468ffe094b/diff:/var/lib/docker/overlay2/cf5b153a83b4cfc77cadc4b00731e9da1849d71ea810a958c38899252aa04b14/diff:/var/lib/docker/overlay2/076f530a6aca12e02e28d73489ab50a46130f0f0c865e1dca0492f8f8cd21d4b/diff:/var/lib/docker/overlay2/75411c089c5d9ef7dbf165092a13604ac410d7edbd58e1029d8c017ab34c51a2/diff",
"MergedDir": "/var/lib/docker/overlay2/88502fb0f1edbe9c6517ef01b7ebf6def09a7d8b2ee8059cee5bc153d8988286/merged",
"UpperDir": "/var/lib/docker/overlay2/88502fb0f1edbe9c6517ef01b7ebf6def09a7d8b2ee8059cee5bc153d8988286/diff",
"WorkDir": "/var/lib/docker/overlay2/88502fb0f1edbe9c6517ef01b7ebf6def09a7d8b2ee8059cee5bc153d8988286/work"
},
"Name": "overlay2"
},
"Mounts": [
	            {
                                                
                                                "Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
	            {
                                                
                                                "Type": "volume",
"Name": "missing-upgrade-047898",
"Source": "/var/lib/docker/volumes/missing-upgrade-047898/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
	        "Config": {
                                                
                                                "Hostname": "missing-upgrade-047898",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
	            "ExposedPorts": {
                                                
                                                	                "22/tcp": {},
                                                
                                                	                "2376/tcp": {},
                                                
                                                	                "32443/tcp": {},
                                                
                                                	                "5000/tcp": {},
                                                
                                                	                "8443/tcp": {}
                                                
                                                },
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
	            "Labels": {
                                                
                                                "created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "missing-upgrade-047898",
"name.minikube.sigs.k8s.io": "missing-upgrade-047898",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
	        "NetworkSettings": {
                                                
                                                "Bridge": "",
"SandboxID": "a28370f2b89a6a65d7acfbc5673ff576e6bcd90045f74c0503b2d4d685ceeee4",
"SandboxKey": "/var/run/docker/netns/a28370f2b89a",
	            "Ports": {
                                                
                                                "22/tcp": [
	                    {
                                                
                                                "HostIp": "127.0.0.1",
"HostPort": "33047"
}
],
"2376/tcp": [
	                    {
                                                
                                                "HostIp": "127.0.0.1",
"HostPort": "33046"
}
],
"32443/tcp": [
	                    {
                                                
                                                "HostIp": "127.0.0.1",
"HostPort": "33043"
}
],
"5000/tcp": [
	                    {
                                                
                                                "HostIp": "127.0.0.1",
"HostPort": "33045"
}
],
"8443/tcp": [
	                    {
                                                
                                                "HostIp": "127.0.0.1",
"HostPort": "33044"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
	            "Networks": {
                                                
                                                	                "missing-upgrade-047898": {
                                                
                                                	                    "IPAMConfig": {
                                                
                                                "IPv4Address": "192.168.103.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:67:02",
"NetworkID": "a97e6098a55f784a5184542e6662225ae04612bf133a2d20da6f2c6a350b661e",
"EndpointID": "828c447ac1fffad1e4f01c8be4a898ef6b6069654b1879e3267bf190857a805d",
"Gateway": "192.168.103.1",
"IPAddress": "192.168.103.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"missing-upgrade-047898",
"03798d26ff36"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p missing-upgrade-047898 -n missing-upgrade-047898
                                                
                                                helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p missing-upgrade-047898 -n missing-upgrade-047898: exit status 2 (291.385463ms)
                                                
                                                -- stdout --
Running
-- /stdout --
helpers_test.go:239: status error: exit status 2 (may be ok)
helpers_test.go:244: <<< TestMissingContainerUpgrade FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestMissingContainerUpgrade]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p missing-upgrade-047898 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p missing-upgrade-047898 logs -n 25: (2.79526422s)
helpers_test.go:252: TestMissingContainerUpgrade logs:
-- stdout --
==> Audit <==
|---------|----------------------------------------|---------------------------|---------|----------------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|----------------------------------------|---------------------------|---------|----------------|---------------------|---------------------|
| ssh | -p cilium-030429 sudo | cilium-030429 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | |
| | cri-dockerd --version | | | | | |
| ssh | -p cilium-030429 sudo | cilium-030429 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | |
| | systemctl status containerd | | | | | |
| | --all --full --no-pager | | | | | |
| ssh | -p cilium-030429 sudo | cilium-030429 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | |
| | systemctl cat containerd | | | | | |
| | --no-pager | | | | | |
| ssh | -p cilium-030429 sudo cat | cilium-030429 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | |
| | /lib/systemd/system/containerd.service | | | | | |
| start | -p force-systemd-env-409143 | force-systemd-env-409143 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | 15 Apr 24 18:15 UTC |
| | --memory=2048 | | | | | |
| | --alsologtostderr | | | | | |
| | -v=5 --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| ssh | -p cilium-030429 sudo cat | cilium-030429 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p cilium-030429 sudo | cilium-030429 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | |
| | containerd config dump | | | | | |
| ssh | -p cilium-030429 sudo | cilium-030429 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p cilium-030429 sudo | cilium-030429 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p cilium-030429 sudo find | cilium-030429 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | |
| | /etc/crio -type f -exec sh -c | | | | | |
	|         | 'echo {}; cat {}' \;                   |                           |         |                |                     |                     |
                                                
                                                | ssh | -p cilium-030429 sudo crio | cilium-030429 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | |
| | config | | | | | |
| delete | -p cilium-030429 | cilium-030429 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | 15 Apr 24 18:15 UTC |
| start | -p running-upgrade-610927 | minikube | jenkins | v1.26.0 | 15 Apr 24 18:15 UTC | 15 Apr 24 18:17 UTC |
| | --memory=2200 | | | | | |
| | --vm-driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | -p offline-docker-702344 | offline-docker-702344 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | 15 Apr 24 18:15 UTC |
| start | -p missing-upgrade-047898 | minikube | jenkins | v1.26.0 | 15 Apr 24 18:15 UTC | 15 Apr 24 18:17 UTC |
| | --memory=2200 --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| ssh | force-systemd-env-409143 | force-systemd-env-409143 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | 15 Apr 24 18:15 UTC |
| | ssh docker info --format | | | | | |
	|         | {{.CgroupDriver}}                      |                           |         |                |                     |                     |
                                                
                                                | delete | -p force-systemd-env-409143 | force-systemd-env-409143 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | 15 Apr 24 18:15 UTC |
| start | -p kubernetes-upgrade-562539 | kubernetes-upgrade-562539 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:15 UTC | 15 Apr 24 18:16 UTC |
| | --memory=2200 | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --alsologtostderr | | | | | |
| | -v=1 --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| stop | -p kubernetes-upgrade-562539 | kubernetes-upgrade-562539 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:16 UTC | 15 Apr 24 18:16 UTC |
| start | -p kubernetes-upgrade-562539 | kubernetes-upgrade-562539 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:16 UTC | |
| | --memory=2200 | | | | | |
| | --kubernetes-version=v1.30.0-rc.2 | | | | | |
| | --alsologtostderr | | | | | |
| | -v=1 --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| start | -p running-upgrade-610927 | running-upgrade-610927 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:17 UTC | 15 Apr 24 18:17 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | -v=1 --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| start | -p missing-upgrade-047898 | missing-upgrade-047898 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:17 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | -v=1 --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | -p running-upgrade-610927 | running-upgrade-610927 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:17 UTC | 15 Apr 24 18:17 UTC |
| start | -p cert-expiration-749798 | cert-expiration-749798 | jenkins | v1.33.0-beta.0 | 15 Apr 24 18:17 UTC | |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| start | -p stopped-upgrade-571200 | minikube | jenkins | v1.26.0 | 15 Apr 24 18:17 UTC | |
| | --memory=2200 | | | | | |
| | --vm-driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
|---------|----------------------------------------|---------------------------|---------|----------------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/04/15 18:17:44
Running on machine: ubuntu-20-agent-10
Binary: Built with gc go1.18.3 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0415 18:17:44.336045 307157 out.go:296] Setting OutFile to fd 1 ...
I0415 18:17:44.336245 307157 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0415 18:17:44.336250 307157 out.go:309] Setting ErrFile to fd 2...
I0415 18:17:44.336253 307157 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0415 18:17:44.336877 307157 root.go:329] Updating PATH: /home/jenkins/minikube-integration/18634-7363/.minikube/bin
I0415 18:17:44.337277 307157 out.go:303] Setting JSON to false
	I0415 18:17:44.338634  307157 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":3610,"bootTime":1713201454,"procs":317,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
                                                
                                                I0415 18:17:44.338716 307157 start.go:125] virtualization: kvm guest
I0415 18:17:44.336649 307033 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713176859-18634@sha256:aa626f490dfc5e9a013f239555a8c57845d8eb915cd55dbd63f6a05070c2709b in local docker daemon
I0415 18:17:44.336663 307033 preload.go:132] Checking if preload exists for k8s version v1.29.3 and runtime docker
I0415 18:17:44.336726 307033 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18634-7363/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.3-docker-overlay2-amd64.tar.lz4
I0415 18:17:44.336744 307033 cache.go:56] Caching tarball of preloaded images
I0415 18:17:44.336847 307033 preload.go:173] Found /home/jenkins/minikube-integration/18634-7363/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0415 18:17:44.336856 307033 cache.go:59] Finished verifying existence of preloaded tar for v1.29.3 on docker
I0415 18:17:44.336965 307033 profile.go:143] Saving config to /home/jenkins/minikube-integration/18634-7363/.minikube/profiles/cert-expiration-749798/config.json ...
I0415 18:17:44.352799 307033 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713176859-18634@sha256:aa626f490dfc5e9a013f239555a8c57845d8eb915cd55dbd63f6a05070c2709b in local docker daemon, skipping pull
I0415 18:17:44.352812 307033 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713176859-18634@sha256:aa626f490dfc5e9a013f239555a8c57845d8eb915cd55dbd63f6a05070c2709b exists in daemon, skipping load
I0415 18:17:44.352833 307033 cache.go:194] Successfully downloaded all kic artifacts
	I0415 18:17:44.352865  307033 start.go:360] acquireMachinesLock for cert-expiration-749798: {Name:mk1ba705fded3a35e7e0c54f8919094bc68037ed Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
                                                
                                                I0415 18:17:44.352930 307033 start.go:364] duration metric: took 47.321µs to acquireMachinesLock for "cert-expiration-749798"
I0415 18:17:44.352977 307033 start.go:96] Skipping create...Using existing machine configuration
I0415 18:17:44.352982 307033 fix.go:54] fixHost starting:
	I0415 18:17:44.353197  307033 cli_runner.go:164] Run: docker container inspect cert-expiration-749798 --format={{.State.Status}}
                                                
                                                I0415 18:17:44.369559 307033 fix.go:112] recreateIfNeeded on cert-expiration-749798: state=Running err=<nil>
W0415 18:17:44.369586 307033 fix.go:138] unexpected machine state, will restart: <nil>
I0415 18:17:44.399707 307157 out.go:177] * [stopped-upgrade-571200] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
I0415 18:17:44.399713 307033 out.go:177] * Updating the running docker "cert-expiration-749798" container ...
I0415 18:17:44.441268 307157 notify.go:193] Checking for updates...
I0415 18:17:44.524694 307157 out.go:177] - MINIKUBE_LOCATION=18634
I0415 18:17:44.603693 307157 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0415 18:17:44.665620 307157 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18634-7363/.minikube
I0415 18:17:44.732203 307157 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0415 18:17:44.789799 307157 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0415 18:17:44.857257 307157 out.go:177] - KUBECONFIG=/tmp/legacy_kubeconfig2465655
I0415 18:17:44.936361 307157 config.go:178] Loaded profile config "cert-expiration-749798": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.29.3
I0415 18:17:44.936503 307157 config.go:178] Loaded profile config "kubernetes-upgrade-562539": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.30.0-rc.2
I0415 18:17:44.936627 307157 config.go:178] Loaded profile config "missing-upgrade-047898": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.1
I0415 18:17:44.936703 307157 driver.go:360] Setting default libvirt URI to qemu:///system
I0415 18:17:44.958413 307157 docker.go:137] docker version: linux-26.0.1
	I0415 18:17:44.958492  307157 cli_runner.go:164] Run: docker system info --format "{{json .}}"
                                                
                                                	I0415 18:17:45.010932  307157 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:44 OomKillDisable:true NGoroutines:68 SystemTime:2024-04-15 18:17:45.000967775 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
                                                
                                                _64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647976448 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-10 Labels:[] ExperimentalBuild:false ServerVersion:26.0.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
                                                
                                                rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
                                                
                                                I0415 18:17:45.011028 307157 docker.go:254] overlay module found
I0415 18:17:45.081766 307157 out.go:177] * Using the docker driver based on user configuration
I0415 18:17:45.146436 307157 start.go:284] selected driver: docker
I0415 18:17:45.146455 307157 start.go:805] validating driver "docker" against <nil>
	I0415 18:17:45.146484  307157 start.go:816] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
                                                
                                                	I0415 18:17:45.147531  307157 cli_runner.go:164] Run: docker system info --format "{{json .}}"
                                                
                                                	I0415 18:17:45.204761  307157 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:44 OomKillDisable:true NGoroutines:68 SystemTime:2024-04-15 18:17:45.191991796 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
                                                
                                                _64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647976448 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-10 Labels:[] ExperimentalBuild:false ServerVersion:26.0.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
                                                
                                                rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
                                                
                                                I0415 18:17:45.204915 307157 start_flags.go:296] no existing cluster config was found, will generate one from the flags
I0415 18:17:45.205122 307157 start_flags.go:835] Wait components to verify : map[apiserver:true system_pods:true]
I0415 18:17:45.254750 307157 out.go:177] * Using Docker driver with root privileges
I0415 18:17:45.301998 307157 cni.go:95] Creating CNI manager for ""
I0415 18:17:45.302015 307157 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0415 18:17:45.302029 307157 start_flags.go:310] config:
	{Name:stopped-upgrade-571200 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:stopped-upgrade-571200 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISock
                                                
                                                et: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0415 18:17:45.307142 307157 out.go:177] * Starting control plane node stopped-upgrade-571200 in cluster stopped-upgrade-571200
I0415 18:17:45.309532 307157 cache.go:120] Beginning downloading kic base image for docker with docker
I0415 18:17:45.312523 307157 out.go:177] * Pulling base image ...
I0415 18:17:45.345012 307157 preload.go:132] Checking if preload exists for k8s version v1.24.1 and runtime docker
I0415 18:17:45.345069 307157 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 in local docker daemon
I0415 18:17:45.345083 307157 preload.go:148] Found local preload: /home/jenkins/minikube-integration/18634-7363/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4
I0415 18:17:45.345095 307157 cache.go:57] Caching tarball of preloaded images
I0415 18:17:45.345462 307157 preload.go:174] Found /home/jenkins/minikube-integration/18634-7363/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0415 18:17:45.345533 307157 cache.go:60] Finished verifying existence of preloaded tar for v1.24.1 on docker
I0415 18:17:45.345704 307157 profile.go:148] Saving config to /home/jenkins/minikube-integration/18634-7363/.minikube/profiles/stopped-upgrade-571200/config.json ...
	I0415 18:17:45.345733  307157 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18634-7363/.minikube/profiles/stopped-upgrade-571200/config.json: {Name:mkee5f989285cabf976a0635c3c7fff41f608ee9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
                                                
                                                I0415 18:17:45.365453 307157 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 in local docker daemon, skipping pull
I0415 18:17:45.365482 307157 cache.go:142] gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 exists in daemon, skipping load
I0415 18:17:45.365505 307157 cache.go:208] Successfully downloaded all kic artifacts
	I0415 18:17:45.365606  307157 start.go:352] acquiring machines lock for stopped-upgrade-571200: {Name:mkb0f701d33c848e7defdc353be7252e49c5b51c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
                                                
                                                I0415 18:17:45.365790 307157 start.go:356] acquired machines lock for "stopped-upgrade-571200" in 159.087µs
	I0415 18:17:45.365834  307157 start.go:91] Provisioning new machine with config: &{Name:stopped-upgrade-571200 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:stopped-upgrade-571200 Namespace:default APIServerName:minikubeCA APIServ
                                                
                                                erNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion
                                                
                                                :v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0415 18:17:45.365930 307157 start.go:131] createHost starting for "" (driver="docker")
I0415 18:17:46.800271 302398 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18634-7363/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-047898:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 -I lz4 -xf /preloaded.tar -C /extractDir: (5.836027996s)
I0415 18:17:46.800306 302398 kic.go:203] duration metric: took 5.836212536s to extract preloaded images to volume ...
W0415 18:17:46.800446 302398 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0415 18:17:46.800558  302398 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
                                                
                                                I0415 18:17:46.860082 302398 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname missing-upgrade-047898 --name missing-upgrade-047898 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-047898 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=missing-upgrade-047898 --network missing-upgrade-047898 --ip 192.168.103.2 --volume missing-upgrade-047898:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95
	I0415 18:17:47.515180  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Running}}
                                                
                                                	I0415 18:17:47.536557  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                I0415 18:17:47.556658 302398 cli_runner.go:164] Run: docker exec missing-upgrade-047898 stat /var/lib/dpkg/alternatives/iptables
I0415 18:17:47.611118 302398 oci.go:144] the created container "missing-upgrade-047898" has a running status.
I0415 18:17:47.611156 302398 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa...
I0415 18:17:48.018550 302398 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0415 18:17:48.043989  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                I0415 18:17:48.062052 302398 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0415 18:17:48.062077 302398 kic_runner.go:114] Args: [docker exec --privileged missing-upgrade-047898 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0415 18:17:48.109956  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                I0415 18:17:48.127033 302398 machine.go:94] provisionDockerMachine start ...
	I0415 18:17:48.127137  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:48.143551 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:48.143828  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:48.143848 302398 main.go:141] libmachine: About to run SSH command:
hostname
I0415 18:17:48.322007 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-047898
I0415 18:17:48.322042 302398 ubuntu.go:169] provisioning hostname "missing-upgrade-047898"
	I0415 18:17:48.322113  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:48.339891 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:48.340089  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:48.340104 302398 main.go:141] libmachine: About to run SSH command:
sudo hostname missing-upgrade-047898 && echo "missing-upgrade-047898" | sudo tee /etc/hostname
I0415 18:17:48.511278 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-047898
	I0415 18:17:48.511373  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:48.528793 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:48.528985  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:48.529011 302398 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smissing-upgrade-047898' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-047898/g' /etc/hosts;
else
echo '127.0.1.1 missing-upgrade-047898' | sudo tee -a /etc/hosts;
fi
fi
I0415 18:17:44.441116 307033 machine.go:94] provisionDockerMachine start ...
	I0415 18:17:44.441232  307033 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-749798
                                                
                                                I0415 18:17:44.461162 307033 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:44.461372  307033 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 32990 <nil> <nil>}
                                                
                                                I0415 18:17:44.461378 307033 main.go:141] libmachine: About to run SSH command:
hostname
I0415 18:17:44.578313 307033 main.go:141] libmachine: SSH cmd err, output: <nil>: cert-expiration-749798
I0415 18:17:44.578330 307033 ubuntu.go:169] provisioning hostname "cert-expiration-749798"
	I0415 18:17:44.578391  307033 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-749798
                                                
                                                I0415 18:17:44.594861 307033 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:44.595032  307033 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 32990 <nil> <nil>}
                                                
                                                I0415 18:17:44.595039 307033 main.go:141] libmachine: About to run SSH command:
sudo hostname cert-expiration-749798 && echo "cert-expiration-749798" | sudo tee /etc/hostname
I0415 18:17:44.731928 307033 main.go:141] libmachine: SSH cmd err, output: <nil>: cert-expiration-749798
	I0415 18:17:44.732006  307033 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-749798
                                                
                                                I0415 18:17:44.749907 307033 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:44.750099  307033 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 32990 <nil> <nil>}
                                                
                                                I0415 18:17:44.750117 307033 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\scert-expiration-749798' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 cert-expiration-749798/g' /etc/hosts;
else
echo '127.0.1.1 cert-expiration-749798' | sudo tee -a /etc/hosts;
fi
fi
I0415 18:17:44.867199 307033 main.go:141] libmachine: SSH cmd err, output: <nil>:
	I0415 18:17:44.867235  307033 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18634-7363/.minikube CaCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18634-7363/.minikube}
                                                
                                                I0415 18:17:44.867257 307033 ubuntu.go:177] setting up certificates
I0415 18:17:44.867269 307033 provision.go:84] configureAuth start
	I0415 18:17:44.867319  307033 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cert-expiration-749798
                                                
                                                I0415 18:17:44.884248 307033 provision.go:143] copyHostCerts
I0415 18:17:44.884293 307033 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem, removing ...
I0415 18:17:44.884299 307033 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem
I0415 18:17:44.935345 307033 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem (1679 bytes)
I0415 18:17:44.935500 307033 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem, removing ...
I0415 18:17:44.935506 307033 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem
I0415 18:17:44.935536 307033 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem (1078 bytes)
I0415 18:17:44.935631 307033 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem, removing ...
I0415 18:17:44.935635 307033 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem
I0415 18:17:44.935659 307033 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem (1123 bytes)
I0415 18:17:44.935700 307033 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca-key.pem org=jenkins.cert-expiration-749798 san=[127.0.0.1 192.168.85.2 cert-expiration-749798 localhost minikube]
I0415 18:17:45.002283 307033 provision.go:177] copyRemoteCerts
I0415 18:17:45.002368 307033 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0415 18:17:45.002415  307033 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-749798
                                                
                                                	I0415 18:17:45.019761  307033 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32990 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/cert-expiration-749798/id_rsa Username:docker}
                                                
                                                I0415 18:17:45.107573 307033 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0415 18:17:45.154048 307033 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0415 18:17:45.180696 307033 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0415 18:17:45.205524 307033 provision.go:87] duration metric: took 338.242358ms to configureAuth
I0415 18:17:45.205547 307033 ubuntu.go:193] setting minikube options for container-runtime
I0415 18:17:45.205714 307033 config.go:182] Loaded profile config "cert-expiration-749798": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.29.3
	I0415 18:17:45.205753  307033 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-749798
                                                
                                                I0415 18:17:45.222374 307033 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:45.222576  307033 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 32990 <nil> <nil>}
                                                
                                                I0415 18:17:45.222586 307033 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0415 18:17:45.343563 307033 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0415 18:17:45.343581 307033 ubuntu.go:71] root file system type: overlay
I0415 18:17:45.343716 307033 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
	I0415 18:17:45.343777  307033 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-749798
                                                
                                                I0415 18:17:45.361888 307033 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:45.362121  307033 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 32990 <nil> <nil>}
                                                
                                                I0415 18:17:45.362219 307033 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0415 18:17:45.495577 307033 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
	I0415 18:17:45.495659  307033 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-749798
                                                
                                                I0415 18:17:45.514379 307033 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:45.514598  307033 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 32990 <nil> <nil>}
                                                
                                                I0415 18:17:45.514617 307033 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
                                                
                                                I0415 18:17:45.644407 307033 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0415 18:17:45.644436 307033 machine.go:97] duration metric: took 1.203305503s to provisionDockerMachine
I0415 18:17:45.644448 307033 start.go:293] postStartSetup for "cert-expiration-749798" (driver="docker")
I0415 18:17:45.644459 307033 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0415 18:17:45.644539 307033 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0415 18:17:45.644578  307033 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-749798
                                                
                                                	I0415 18:17:45.664644  307033 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32990 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/cert-expiration-749798/id_rsa Username:docker}
                                                
                                                I0415 18:17:45.752993 307033 ssh_runner.go:195] Run: cat /etc/os-release
I0415 18:17:45.756097 307033 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0415 18:17:45.756121 307033 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0415 18:17:45.756128 307033 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0415 18:17:45.756133 307033 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0415 18:17:45.756140 307033 filesync.go:126] Scanning /home/jenkins/minikube-integration/18634-7363/.minikube/addons for local assets ...
I0415 18:17:45.756183 307033 filesync.go:126] Scanning /home/jenkins/minikube-integration/18634-7363/.minikube/files for local assets ...
I0415 18:17:45.756248 307033 filesync.go:149] local asset: /home/jenkins/minikube-integration/18634-7363/.minikube/files/etc/ssl/certs/142912.pem -> 142912.pem in /etc/ssl/certs
I0415 18:17:45.756320 307033 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0415 18:17:45.764169 307033 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/files/etc/ssl/certs/142912.pem --> /etc/ssl/certs/142912.pem (1708 bytes)
I0415 18:17:45.800259 307033 start.go:296] duration metric: took 155.796379ms for postStartSetup
	I0415 18:17:45.800345  307033 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
                                                
                                                	I0415 18:17:45.800396  307033 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-749798
                                                
                                                	I0415 18:17:45.818393  307033 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32990 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/cert-expiration-749798/id_rsa Username:docker}
                                                
                                                	I0415 18:17:45.907724  307033 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
                                                
                                                I0415 18:17:45.912256 307033 fix.go:56] duration metric: took 1.55926659s for fixHost
I0415 18:17:45.912273 307033 start.go:83] releasing machines lock for "cert-expiration-749798", held for 1.559334675s
	I0415 18:17:45.912333  307033 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cert-expiration-749798
                                                
                                                I0415 18:17:45.928401 307033 ssh_runner.go:195] Run: cat /version.json
	I0415 18:17:45.928434  307033 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-749798
                                                
                                                I0415 18:17:45.928528 307033 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0415 18:17:45.928572  307033 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-749798
                                                
                                                	I0415 18:17:45.948352  307033 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32990 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/cert-expiration-749798/id_rsa Username:docker}
                                                
                                                	I0415 18:17:45.949841  307033 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32990 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/cert-expiration-749798/id_rsa Username:docker}
                                                
                                                I0415 18:17:46.034392 307033 ssh_runner.go:195] Run: systemctl --version
I0415 18:17:46.107481 307033 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0415 18:17:46.111865  307033 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
                                                
                                                I0415 18:17:46.154199 307033 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0415 18:17:46.154252  307033 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
                                                
                                                I0415 18:17:46.162618 307033 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0415 18:17:46.162639 307033 start.go:494] detecting cgroup driver to use...
I0415 18:17:46.162671 307033 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0415 18:17:46.162766 307033 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0415 18:17:46.213997 307033 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0415 18:17:46.279712 307033 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0415 18:17:46.338229 307033 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0415 18:17:46.338287 307033 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0415 18:17:46.400575 307033 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0415 18:17:46.462130 307033 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0415 18:17:46.476386 307033 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0415 18:17:46.489333 307033 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0415 18:17:46.498889 307033 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0415 18:17:46.516238 307033 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0415 18:17:46.538722 307033 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0415 18:17:46.565811 307033 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0415 18:17:46.574591 307033 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0415 18:17:46.582903 307033 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0415 18:17:46.682599 307033 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0415 18:17:46.212414 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0415 18:17:46.212460 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:47.022445 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": read tcp 192.168.76.1:60772->192.168.76.2:8443: read: connection reset by peer
I0415 18:17:47.022499 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:47.022921 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:47.209316 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:47.209726 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:47.709945 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:47.710363 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:48.209977 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:48.210427 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:48.709015 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:48.709424 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:45.460761 307157 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0415 18:17:45.461143 307157 start.go:165] libmachine.API.Create for "stopped-upgrade-571200" (driver="docker")
I0415 18:17:45.461183 307157 client.go:168] LocalClient.Create starting
I0415 18:17:45.461282 307157 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem
I0415 18:17:45.461321 307157 main.go:134] libmachine: Decoding PEM data...
I0415 18:17:45.461341 307157 main.go:134] libmachine: Parsing certificate...
I0415 18:17:45.461428 307157 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem
I0415 18:17:45.461448 307157 main.go:134] libmachine: Decoding PEM data...
I0415 18:17:45.461460 307157 main.go:134] libmachine: Parsing certificate...
	I0415 18:17:45.461967  307157 cli_runner.go:164] Run: docker network inspect stopped-upgrade-571200 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
                                                
                                                	W0415 18:17:45.478057  307157 cli_runner.go:211] docker network inspect stopped-upgrade-571200 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
                                                
                                                I0415 18:17:45.478132 307157 network_create.go:272] running [docker network inspect stopped-upgrade-571200] to gather additional debugging logs...
I0415 18:17:45.478148 307157 cli_runner.go:164] Run: docker network inspect stopped-upgrade-571200
W0415 18:17:45.495179 307157 cli_runner.go:211] docker network inspect stopped-upgrade-571200 returned with exit code 1
I0415 18:17:45.495203 307157 network_create.go:275] error running [docker network inspect stopped-upgrade-571200]: docker network inspect stopped-upgrade-571200: exit status 1
stdout:
[]
stderr:
Error response from daemon: network stopped-upgrade-571200 not found
I0415 18:17:45.495218 307157 network_create.go:277] output of [docker network inspect stopped-upgrade-571200]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network stopped-upgrade-571200 not found
** /stderr **
	I0415 18:17:45.495257  307157 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
                                                
                                                	I0415 18:17:45.513802  307157 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-6760c7135419 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:63:de:de:fa}}
                                                
                                                	I0415 18:17:45.514771  307157 network.go:240] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName:br-ee0168a20982 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:18:0e:e7:8c}}
                                                
                                                	I0415 18:17:45.515642  307157 network.go:240] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 Interface:{IfaceName:br-38de591302a2 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:2e:f3:12:62}}
                                                
                                                	I0415 18:17:45.516224  307157 network.go:240] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 Interface:{IfaceName:br-a60028b212fd IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:54:37:c4:53}}
                                                
                                                	I0415 18:17:45.517349  307157 network.go:240] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 Interface:{IfaceName:br-e3b283515f32 IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:02:42:0b:28:56:90}}
                                                
                                                	I0415 18:17:45.518073  307157 network.go:288] reserving subnet 192.168.94.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.94.0:0xc000e44178] misses:0}
                                                
                                                	I0415 18:17:45.518103  307157 network.go:235] using free private subnet 192.168.94.0/24: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
                                                
                                                I0415 18:17:45.518117 307157 network_create.go:115] attempt to create docker network stopped-upgrade-571200 192.168.94.0/24 with gateway 192.168.94.1 and MTU of 1500 ...
I0415 18:17:45.518166 307157 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.94.0/24 --gateway=192.168.94.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=stopped-upgrade-571200 stopped-upgrade-571200
I0415 18:17:45.620278 307157 network_create.go:99] docker network stopped-upgrade-571200 192.168.94.0/24 created
I0415 18:17:45.620301 307157 kic.go:106] calculated static IP "192.168.94.2" for the "stopped-upgrade-571200" container
	I0415 18:17:45.620355  307157 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
                                                
                                                I0415 18:17:45.636448 307157 cli_runner.go:164] Run: docker volume create stopped-upgrade-571200 --label name.minikube.sigs.k8s.io=stopped-upgrade-571200 --label created_by.minikube.sigs.k8s.io=true
I0415 18:17:45.732944 307157 oci.go:103] Successfully created a docker volume stopped-upgrade-571200
I0415 18:17:45.733025 307157 cli_runner.go:164] Run: docker run --rm --name stopped-upgrade-571200-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=stopped-upgrade-571200 --entrypoint /usr/bin/test -v stopped-upgrade-571200:/var gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 -d /var/lib
I0415 18:17:47.456505 307157 cli_runner.go:217] Completed: docker run --rm --name stopped-upgrade-571200-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=stopped-upgrade-571200 --entrypoint /usr/bin/test -v stopped-upgrade-571200:/var gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 -d /var/lib: (1.723439863s)
I0415 18:17:47.456524 307157 oci.go:107] Successfully prepared a docker volume stopped-upgrade-571200
I0415 18:17:47.456543 307157 preload.go:132] Checking if preload exists for k8s version v1.24.1 and runtime docker
I0415 18:17:47.456560 307157 kic.go:179] Starting extracting preloaded images to volume ...
I0415 18:17:47.456610 307157 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18634-7363/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v stopped-upgrade-571200:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 -I lz4 -xf /preloaded.tar -C /extractDir
I0415 18:17:48.654615 302398 main.go:141] libmachine: SSH cmd err, output: <nil>:
	I0415 18:17:48.654644  302398 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18634-7363/.minikube CaCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18634-7363/.minikube}
                                                
                                                I0415 18:17:48.654685 302398 ubuntu.go:177] setting up certificates
I0415 18:17:48.654697 302398 provision.go:84] configureAuth start
	I0415 18:17:48.654772  302398 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-047898
                                                
                                                I0415 18:17:48.672302 302398 provision.go:143] copyHostCerts
I0415 18:17:48.672385 302398 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem, removing ...
I0415 18:17:48.672401 302398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem
I0415 18:17:48.687091 302398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem (1679 bytes)
I0415 18:17:48.687247 302398 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem, removing ...
I0415 18:17:48.687262 302398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem
I0415 18:17:48.687310 302398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem (1078 bytes)
I0415 18:17:48.687403 302398 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem, removing ...
I0415 18:17:48.687414 302398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem
I0415 18:17:48.687446 302398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem (1123 bytes)
I0415 18:17:48.687573 302398 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-047898 san=[127.0.0.1 192.168.103.2 localhost minikube missing-upgrade-047898]
I0415 18:17:48.790840 302398 provision.go:177] copyRemoteCerts
I0415 18:17:48.790922 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0415 18:17:48.791000  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:48.807073  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                I0415 18:17:48.894122 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0415 18:17:48.949894 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0415 18:17:48.972019 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0415 18:17:48.993434 302398 provision.go:87] duration metric: took 338.707703ms to configureAuth
I0415 18:17:48.993473 302398 ubuntu.go:193] setting minikube options for container-runtime
I0415 18:17:48.993722 302398 config.go:182] Loaded profile config "missing-upgrade-047898": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0415 18:17:48.993796  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:49.011898 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:49.012163  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:49.012197 302398 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0415 18:17:49.143384 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0415 18:17:49.143418 302398 ubuntu.go:71] root file system type: overlay
I0415 18:17:49.143534 302398 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
	I0415 18:17:49.143597  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:49.161680 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:49.161948  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:49.162056 302398 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0415 18:17:49.337493 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
	I0415 18:17:49.337614  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:49.357793 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:49.358081  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:49.358120 302398 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
                                                
                                                I0415 18:17:51.271398 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-06-06 23:01:03.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2024-04-15 18:17:49.333299778 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0415 18:17:51.271440 302398 machine.go:97] duration metric: took 3.144377385s to provisionDockerMachine
I0415 18:17:51.271460 302398 client.go:171] duration metric: took 10.869565106s to LocalClient.Create
I0415 18:17:51.271478 302398 start.go:167] duration metric: took 10.869614646s to libmachine.API.Create "missing-upgrade-047898"
I0415 18:17:51.271493 302398 start.go:293] postStartSetup for "missing-upgrade-047898" (driver="docker")
I0415 18:17:51.271509 302398 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0415 18:17:51.271575 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0415 18:17:51.271633  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:51.290651  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                I0415 18:17:51.382297 302398 ssh_runner.go:195] Run: cat /etc/os-release
I0415 18:17:51.385171 302398 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0415 18:17:51.385201 302398 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0415 18:17:51.385215 302398 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0415 18:17:51.385223 302398 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0415 18:17:51.385234 302398 filesync.go:126] Scanning /home/jenkins/minikube-integration/18634-7363/.minikube/addons for local assets ...
I0415 18:17:51.385289 302398 filesync.go:126] Scanning /home/jenkins/minikube-integration/18634-7363/.minikube/files for local assets ...
I0415 18:17:51.385380 302398 filesync.go:149] local asset: /home/jenkins/minikube-integration/18634-7363/.minikube/files/etc/ssl/certs/142912.pem -> 142912.pem in /etc/ssl/certs
I0415 18:17:51.385497 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0415 18:17:51.393018 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/files/etc/ssl/certs/142912.pem --> /etc/ssl/certs/142912.pem (1708 bytes)
I0415 18:17:51.412102 302398 start.go:296] duration metric: took 140.589799ms for postStartSetup
	I0415 18:17:51.412500  302398 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-047898
                                                
                                                I0415 18:17:51.429808 302398 profile.go:143] Saving config to /home/jenkins/minikube-integration/18634-7363/.minikube/profiles/missing-upgrade-047898/config.json ...
	I0415 18:17:51.430039  302398 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
                                                
                                                	I0415 18:17:51.430082  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:51.445760  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                	I0415 18:17:51.568146  302398 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
                                                
                                                I0415 18:17:51.574859 302398 start.go:128] duration metric: took 11.175505883s to createHost
	I0415 18:17:51.574951  302398 cli_runner.go:164] Run: docker container inspect missing-upgrade-047898 --format={{.State.Status}}
                                                
                                                W0415 18:17:51.593832 302398 fix.go:138] unexpected machine state, will restart: <nil>
I0415 18:17:51.593875 302398 machine.go:94] provisionDockerMachine start ...
	I0415 18:17:51.593949  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:51.612011 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:51.612224  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:51.612238 302398 main.go:141] libmachine: About to run SSH command:
hostname
I0415 18:17:51.737987 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-047898
I0415 18:17:51.738019 302398 ubuntu.go:169] provisioning hostname "missing-upgrade-047898"
	I0415 18:17:51.738105  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:51.758846 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:51.759077  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:51.759094 302398 main.go:141] libmachine: About to run SSH command:
sudo hostname missing-upgrade-047898 && echo "missing-upgrade-047898" | sudo tee /etc/hostname
I0415 18:17:51.901497 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-047898
	I0415 18:17:51.901587  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:51.922468 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:51.922718  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:51.922742 302398 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smissing-upgrade-047898' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-047898/g' /etc/hosts;
else
echo '127.0.1.1 missing-upgrade-047898' | sudo tee -a /etc/hosts;
fi
fi
I0415 18:17:52.050589 302398 main.go:141] libmachine: SSH cmd err, output: <nil>:
	I0415 18:17:52.050638  302398 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18634-7363/.minikube CaCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18634-7363/.minikube}
                                                
                                                I0415 18:17:52.050670 302398 ubuntu.go:177] setting up certificates
I0415 18:17:52.050682 302398 provision.go:84] configureAuth start
	I0415 18:17:52.050729  302398 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-047898
                                                
                                                I0415 18:17:52.068356 302398 provision.go:143] copyHostCerts
I0415 18:17:52.068426 302398 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem, removing ...
I0415 18:17:52.068442 302398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem
I0415 18:17:52.068516 302398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem (1078 bytes)
I0415 18:17:52.068631 302398 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem, removing ...
I0415 18:17:52.068642 302398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem
I0415 18:17:52.068684 302398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem (1123 bytes)
I0415 18:17:52.068777 302398 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem, removing ...
I0415 18:17:52.068791 302398 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem
I0415 18:17:52.068835 302398 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem (1679 bytes)
I0415 18:17:52.068923 302398 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-047898 san=[127.0.0.1 192.168.103.2 localhost minikube missing-upgrade-047898]
I0415 18:17:52.210968 302398 provision.go:177] copyRemoteCerts
I0415 18:17:52.211025 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0415 18:17:52.211062  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:52.227485  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                I0415 18:17:52.318199 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0415 18:17:52.335580 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0415 18:17:52.353506 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0415 18:17:52.371578 302398 provision.go:87] duration metric: took 320.884089ms to configureAuth
I0415 18:17:52.371625 302398 ubuntu.go:193] setting minikube options for container-runtime
I0415 18:17:52.371776 302398 config.go:182] Loaded profile config "missing-upgrade-047898": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0415 18:17:52.371824  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:52.388003 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:52.388211  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:52.388228 302398 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0415 18:17:52.511941 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0415 18:17:52.511968 302398 ubuntu.go:71] root file system type: overlay
I0415 18:17:52.512104 302398 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
	I0415 18:17:52.512171  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:52.528775 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:52.529007  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:52.529111 302398 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0415 18:17:52.664049 302398 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
	I0415 18:17:52.664142  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                I0415 18:17:52.684074 302398 main.go:141] libmachine: Using SSH client type: native
	I0415 18:17:52.684304  302398 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 127.0.0.1 33047 <nil> <nil>}
                                                
                                                I0415 18:17:52.684330 302398 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
                                                
                                                I0415 18:17:52.809930 302398 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0415 18:17:52.809960 302398 machine.go:97] duration metric: took 1.21607558s to provisionDockerMachine
I0415 18:17:52.809975 302398 start.go:293] postStartSetup for "missing-upgrade-047898" (driver="docker")
I0415 18:17:52.809990 302398 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0415 18:17:52.810062 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0415 18:17:52.810111  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:52.826914  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                I0415 18:17:52.918570 302398 ssh_runner.go:195] Run: cat /etc/os-release
I0415 18:17:52.921770 302398 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0415 18:17:52.921807 302398 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0415 18:17:52.921823 302398 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0415 18:17:52.921832 302398 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0415 18:17:52.921846 302398 filesync.go:126] Scanning /home/jenkins/minikube-integration/18634-7363/.minikube/addons for local assets ...
I0415 18:17:52.921906 302398 filesync.go:126] Scanning /home/jenkins/minikube-integration/18634-7363/.minikube/files for local assets ...
I0415 18:17:52.921992 302398 filesync.go:149] local asset: /home/jenkins/minikube-integration/18634-7363/.minikube/files/etc/ssl/certs/142912.pem -> 142912.pem in /etc/ssl/certs
I0415 18:17:52.922098 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0415 18:17:52.929136 302398 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/files/etc/ssl/certs/142912.pem --> /etc/ssl/certs/142912.pem (1708 bytes)
I0415 18:17:52.948225 302398 start.go:296] duration metric: took 138.235595ms for postStartSetup
	I0415 18:17:52.948308  302398 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
                                                
                                                	I0415 18:17:52.948360  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:52.966271  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                	I0415 18:17:53.054990  302398 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
                                                
                                                I0415 18:17:53.058996 302398 fix.go:56] duration metric: took 34.316129333s for fixHost
I0415 18:17:53.059027 302398 start.go:83] releasing machines lock for "missing-upgrade-047898", held for 34.316184825s
	I0415 18:17:53.059099  302398 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-047898
                                                
                                                I0415 18:17:53.075031 302398 ssh_runner.go:195] Run: cat /version.json
I0415 18:17:53.075057 302398 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0415 18:17:53.075091  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:53.075145  302398 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-047898
                                                
                                                	I0415 18:17:53.099092  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                	I0415 18:17:53.100820  302398 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33047 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/missing-upgrade-047898/id_rsa Username:docker}
                                                
                                                W0415 18:17:53.214611 302398 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
stdout:
stderr:
cat: /version.json: No such file or directory
I0415 18:17:53.214696 302398 ssh_runner.go:195] Run: systemctl --version
I0415 18:17:53.218612 302398 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0415 18:17:53.222672  302398 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
                                                
                                                I0415 18:17:53.243453 302398 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0415 18:17:53.243576  302398 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
                                                
                                                	I0415 18:17:53.262636  302398 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
                                                
                                                I0415 18:17:53.270067 302398 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0415 18:17:53.270095 302398 start.go:494] detecting cgroup driver to use...
I0415 18:17:53.270129 302398 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0415 18:17:53.270240 302398 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0415 18:17:53.283322 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.7"|' /etc/containerd/config.toml"
I0415 18:17:53.291408 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0415 18:17:53.299998 302398 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0415 18:17:53.300065 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0415 18:17:53.308625 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0415 18:17:53.316771 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0415 18:17:53.324998 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0415 18:17:53.333387 302398 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0415 18:17:53.341642 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0415 18:17:53.350710 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0415 18:17:53.359767 302398 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0415 18:17:53.368381 302398 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0415 18:17:53.375631 302398 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0415 18:17:53.382724 302398 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0415 18:17:53.468612 302398 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0415 18:17:49.209098 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:49.209487 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:49.709063 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:49.709494 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:50.209064 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:50.209610 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:50.709114 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:50.709551 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:51.209074 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:51.209494 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:51.709104 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:51.709485 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:52.209086 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:52.209574 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:52.709115 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:52.709505 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:53.209005 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:53.209426 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:53.709986 293270 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0415 18:17:53.710337 293270 api_server.go:269] stopped: https://192.168.76.2:8443/healthz: Get "https://192.168.76.2:8443/healthz": dial tcp 192.168.76.2:8443: connect: connection refused
I0415 18:17:53.555627 302398 start.go:494] detecting cgroup driver to use...
I0415 18:17:53.555677 302398 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0415 18:17:53.555729 302398 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0415 18:17:53.565760 302398 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0415 18:17:53.565823 302398 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0415 18:17:53.575621 302398 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0415 18:17:53.589543 302398 ssh_runner.go:195] Run: which cri-dockerd
I0415 18:17:53.592461 302398 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0415 18:17:53.599265 302398 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0415 18:17:53.612979 302398 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0415 18:17:53.693466 302398 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0415 18:17:53.769636 302398 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0415 18:17:53.771714 302398 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0415 18:17:53.786055 302398 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0415 18:17:53.875350 302398 ssh_runner.go:195] Run: sudo systemctl restart docker
I0415 18:17:53.934904 302398 ssh_runner.go:195] Run: sudo journalctl --no-pager -u docker
I0415 18:17:53.951530 302398 out.go:177]
W0415 18:17:53.952846 302398 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1
stdout:
stderr:
Job for docker.service failed because the control process exited with error code.
See "systemctl status docker.service" and "journalctl -xe" for details.
sudo journalctl --no-pager -u docker:
-- stdout --
-- Logs begin at Mon 2024-04-15 18:17:47 UTC, end at Mon 2024-04-15 18:17:53 UTC. --
Apr 15 18:17:47 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.962666496Z" level=info msg="Starting up"
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.964316038Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.964343675Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
	Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.964365662Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
                                                
                                                Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.964382930Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.965975424Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.965996199Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
	Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.966028523Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
                                                
                                                Apr 15 18:17:47 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:47.966040787Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.497455375Z" level=info msg="[graphdriver] using prior storage driver: overlay2"
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.625137319Z" level=warning msg="Your kernel does not support CPU realtime scheduler"
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.625176492Z" level=warning msg="Your kernel does not support cgroup blkio weight"
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.625184606Z" level=warning msg="Your kernel does not support cgroup blkio weight_device"
Apr 15 18:17:48 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:48.625419138Z" level=info msg="Loading containers: start."
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.048623948Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.089282581Z" level=info msg="Loading containers: done."
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.345105072Z" level=info msg="Docker daemon" commit=a89b842 graphdriver(s)=overlay2 version=20.10.17
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.345196133Z" level=info msg="Daemon has completed initialization"
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: Started Docker Application Container Engine.
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.365336367Z" level=info msg="API listen on /run/docker.sock"
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: docker.service: Current command vanished from the unit file, execution of the command list won't be resumed.
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: Stopping Docker Application Container Engine...
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.880378835Z" level=info msg="Processing signal 'terminated'"
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.882617095Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby
Apr 15 18:17:49 missing-upgrade-047898 dockerd[257]: time="2024-04-15T18:17:49.883639774Z" level=info msg="Daemon shutdown complete"
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: docker.service: Succeeded.
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:49 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.930702143Z" level=info msg="Starting up"
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.932838345Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.932866036Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
	Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.932888130Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
                                                
                                                Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.932897170Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.934304089Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.934330911Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
	Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.934350661Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
                                                
                                                Apr 15 18:17:49 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:49.934367619Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.077000286Z" level=info msg="[graphdriver] using prior storage driver: overlay2"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.083296271Z" level=warning msg="Your kernel does not support CPU realtime scheduler"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.083318632Z" level=warning msg="Your kernel does not support cgroup blkio weight"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.083324418Z" level=warning msg="Your kernel does not support cgroup blkio weight_device"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.083471034Z" level=info msg="Loading containers: start."
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.189383569Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.229403886Z" level=info msg="Loading containers: done."
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.251328914Z" level=info msg="Docker daemon" commit=a89b842 graphdriver(s)=overlay2 version=20.10.17
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.251424991Z" level=info msg="Daemon has completed initialization"
Apr 15 18:17:51 missing-upgrade-047898 systemd[1]: Started Docker Application Container Engine.
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.278370868Z" level=info msg="API listen on [::]:2376"
Apr 15 18:17:51 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:51.283934020Z" level=info msg="API listen on /var/run/docker.sock"
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Stopping Docker Application Container Engine...
Apr 15 18:17:53 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:53.477264601Z" level=info msg="Processing signal 'terminated'"
Apr 15 18:17:53 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:53.479049429Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby
Apr 15 18:17:53 missing-upgrade-047898 dockerd[548]: time="2024-04-15T18:17:53.480333796Z" level=info msg="Daemon shutdown complete"
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Succeeded.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:53 missing-upgrade-047898 dockerd[903]: time="2024-04-15T18:17:53.599703849Z" level=info msg="Starting up"
Apr 15 18:17:53 missing-upgrade-047898 dockerd[903]: failed to create API server: Error reading X509 key pair (cert: "/etc/docker/server.pem", key: "/etc/docker/server-key.pem"): tls: private key does not match public key. Make sure the key is not encrypted.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Failed to start Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Scheduled restart job, restart counter is at 1.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:53 missing-upgrade-047898 dockerd[961]: time="2024-04-15T18:17:53.831506135Z" level=info msg="Starting up"
Apr 15 18:17:53 missing-upgrade-047898 dockerd[961]: failed to create API server: Error reading X509 key pair (cert: "/etc/docker/server.pem", key: "/etc/docker/server-key.pem"): tls: private key does not match public key. Make sure the key is not encrypted.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Failed to start Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:53 missing-upgrade-047898 dockerd[992]: time="2024-04-15T18:17:53.928851683Z" level=info msg="Starting up"
Apr 15 18:17:53 missing-upgrade-047898 dockerd[992]: failed to create API server: Error reading X509 key pair (cert: "/etc/docker/server.pem", key: "/etc/docker/server-key.pem"): tls: private key does not match public key. Make sure the key is not encrypted.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Failed to start Docker Application Container Engine.
-- /stdout --
W0415 18:17:53.952888 302398 out.go:239] *
W0415 18:17:53.953674 302398 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0415 18:17:53.955724 302398 out.go:177]
I0415 18:17:51.143422 307157 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18634-7363/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v stopped-upgrade-571200:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 -I lz4 -xf /preloaded.tar -C /extractDir: (3.686746844s)
I0415 18:17:51.143484 307157 kic.go:188] duration metric: took 3.686918 seconds to extract preloaded images to volume
W0415 18:17:51.143631 307157 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0415 18:17:51.143733  307157 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
                                                
                                                I0415 18:17:51.191124 307157 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname stopped-upgrade-571200 --name stopped-upgrade-571200 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=stopped-upgrade-571200 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=stopped-upgrade-571200 --network stopped-upgrade-571200 --ip 192.168.94.2 --volume stopped-upgrade-571200:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95
	I0415 18:17:51.506998  307157 cli_runner.go:164] Run: docker container inspect stopped-upgrade-571200 --format={{.State.Running}}
                                                
                                                	I0415 18:17:51.525026  307157 cli_runner.go:164] Run: docker container inspect stopped-upgrade-571200 --format={{.State.Status}}
                                                
                                                I0415 18:17:51.544577 307157 cli_runner.go:164] Run: docker exec stopped-upgrade-571200 stat /var/lib/dpkg/alternatives/iptables
I0415 18:17:51.584332 307157 oci.go:144] the created container "stopped-upgrade-571200" has a running status.
I0415 18:17:51.584358 307157 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/18634-7363/.minikube/machines/stopped-upgrade-571200/id_rsa...
I0415 18:17:51.822969 307157 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/18634-7363/.minikube/machines/stopped-upgrade-571200/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0415 18:17:51.848083  307157 cli_runner.go:164] Run: docker container inspect stopped-upgrade-571200 --format={{.State.Status}}
                                                
                                                I0415 18:17:51.867515 307157 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0415 18:17:51.867528 307157 kic_runner.go:114] Args: [docker exec --privileged stopped-upgrade-571200 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0415 18:17:51.915089  307157 cli_runner.go:164] Run: docker container inspect stopped-upgrade-571200 --format={{.State.Status}}
                                                
                                                I0415 18:17:51.934227 307157 machine.go:88] provisioning docker machine ...
I0415 18:17:51.934262 307157 ubuntu.go:169] provisioning hostname "stopped-upgrade-571200"
	I0415 18:17:51.934326  307157 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-571200
                                                
                                                I0415 18:17:51.952489 307157 main.go:134] libmachine: Using SSH client type: native
	I0415 18:17:51.952668  307157 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 33052 <nil> <nil>}
                                                
                                                I0415 18:17:51.952678 307157 main.go:134] libmachine: About to run SSH command:
sudo hostname stopped-upgrade-571200 && echo "stopped-upgrade-571200" | sudo tee /etc/hostname
I0415 18:17:52.091985 307157 main.go:134] libmachine: SSH cmd err, output: <nil>: stopped-upgrade-571200
	I0415 18:17:52.092058  307157 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-571200
                                                
                                                I0415 18:17:52.109527 307157 main.go:134] libmachine: Using SSH client type: native
	I0415 18:17:52.109667  307157 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 33052 <nil> <nil>}
                                                
                                                I0415 18:17:52.109679 307157 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\sstopped-upgrade-571200' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 stopped-upgrade-571200/g' /etc/hosts;
else
echo '127.0.1.1 stopped-upgrade-571200' | sudo tee -a /etc/hosts;
fi
fi
I0415 18:17:52.238894 307157 main.go:134] libmachine: SSH cmd err, output: <nil>:
	I0415 18:17:52.238919  307157 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18634-7363/.minikube CaCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18634-7363/.minikube}
                                                
                                                I0415 18:17:52.238940 307157 ubuntu.go:177] setting up certificates
I0415 18:17:52.238949 307157 provision.go:83] configureAuth start
	I0415 18:17:52.238995  307157 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-571200
                                                
                                                I0415 18:17:52.255311 307157 provision.go:138] copyHostCerts
I0415 18:17:52.255368 307157 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem, removing ...
I0415 18:17:52.255376 307157 exec_runner.go:207] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem
I0415 18:17:52.255445 307157 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/ca.pem (1078 bytes)
I0415 18:17:52.255521 307157 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem, removing ...
I0415 18:17:52.255528 307157 exec_runner.go:207] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem
I0415 18:17:52.255556 307157 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/cert.pem (1123 bytes)
I0415 18:17:52.255604 307157 exec_runner.go:144] found /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem, removing ...
I0415 18:17:52.255607 307157 exec_runner.go:207] rm: /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem
I0415 18:17:52.255630 307157 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18634-7363/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18634-7363/.minikube/key.pem (1679 bytes)
I0415 18:17:52.255669 307157 provision.go:112] generating server cert: /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca-key.pem org=jenkins.stopped-upgrade-571200 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube stopped-upgrade-571200]
I0415 18:17:52.337135 307157 provision.go:172] copyRemoteCerts
I0415 18:17:52.337176 307157 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0415 18:17:52.337216  307157 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-571200
                                                
                                                	I0415 18:17:52.354420  307157 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33052 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/stopped-upgrade-571200/id_rsa Username:docker}
                                                
                                                I0415 18:17:52.442513 307157 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I0415 18:17:52.461676 307157 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0415 18:17:52.480356 307157 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0415 18:17:52.499343 307157 provision.go:86] duration metric: configureAuth took 260.381694ms
I0415 18:17:52.499360 307157 ubuntu.go:193] setting minikube options for container-runtime
I0415 18:17:52.499517 307157 config.go:178] Loaded profile config "stopped-upgrade-571200": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0415 18:17:52.499556  307157 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-571200
                                                
                                                I0415 18:17:52.517161 307157 main.go:134] libmachine: Using SSH client type: native
	I0415 18:17:52.517361  307157 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 33052 <nil> <nil>}
                                                
                                                I0415 18:17:52.517374 307157 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0415 18:17:52.647112 307157 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay
I0415 18:17:52.647129 307157 ubuntu.go:71] root file system type: overlay
I0415 18:17:52.647326 307157 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I0415 18:17:52.647392  307157 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-571200
                                                
                                                I0415 18:17:52.665162 307157 main.go:134] libmachine: Using SSH client type: native
	I0415 18:17:52.665358  307157 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 33052 <nil> <nil>}
                                                
                                                I0415 18:17:52.665451 307157 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0415 18:17:52.807527 307157 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
	I0415 18:17:52.807583  307157 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-571200
                                                
                                                I0415 18:17:52.824188 307157 main.go:134] libmachine: Using SSH client type: native
	I0415 18:17:52.824358  307157 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil>  [] 0s} 127.0.0.1 33052 <nil> <nil>}
                                                
                                                I0415 18:17:52.824378 307157 main.go:134] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
                                                
                                                I0415 18:17:53.514432 307157 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-06-06 23:01:03.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2024-04-15 18:17:52.801603716 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0415 18:17:53.514462 307157 machine.go:91] provisioned docker machine in 1.580218384s
I0415 18:17:53.514472 307157 client.go:171] LocalClient.Create took 8.053284619s
I0415 18:17:53.514483 307157 start.go:173] duration metric: libmachine.API.Create for "stopped-upgrade-571200" took 8.053343904s
I0415 18:17:53.514493 307157 start.go:306] post-start starting for "stopped-upgrade-571200" (driver="docker")
I0415 18:17:53.514498 307157 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0415 18:17:53.514557 307157 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0415 18:17:53.514591  307157 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-571200
                                                
                                                	I0415 18:17:53.537755  307157 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33052 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/stopped-upgrade-571200/id_rsa Username:docker}
                                                
                                                I0415 18:17:53.626738 307157 ssh_runner.go:195] Run: cat /etc/os-release
I0415 18:17:53.629618 307157 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0415 18:17:53.629638 307157 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0415 18:17:53.629647 307157 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0415 18:17:53.629653 307157 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0415 18:17:53.629663 307157 filesync.go:126] Scanning /home/jenkins/minikube-integration/18634-7363/.minikube/addons for local assets ...
I0415 18:17:53.629712 307157 filesync.go:126] Scanning /home/jenkins/minikube-integration/18634-7363/.minikube/files for local assets ...
I0415 18:17:53.629769 307157 filesync.go:149] local asset: /home/jenkins/minikube-integration/18634-7363/.minikube/files/etc/ssl/certs/142912.pem -> 142912.pem in /etc/ssl/certs
I0415 18:17:53.629841 307157 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0415 18:17:53.637176 307157 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18634-7363/.minikube/files/etc/ssl/certs/142912.pem --> /etc/ssl/certs/142912.pem (1708 bytes)
I0415 18:17:53.658756 307157 start.go:309] post-start completed in 144.246725ms
	I0415 18:17:53.659160  307157 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-571200
                                                
                                                I0415 18:17:53.675774 307157 profile.go:148] Saving config to /home/jenkins/minikube-integration/18634-7363/.minikube/profiles/stopped-upgrade-571200/config.json ...
	I0415 18:17:53.676014  307157 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
                                                
                                                	I0415 18:17:53.676050  307157 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-571200
                                                
                                                	I0415 18:17:53.693252  307157 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33052 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/stopped-upgrade-571200/id_rsa Username:docker}
                                                
                                                	I0415 18:17:53.779059  307157 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
                                                
                                                I0415 18:17:53.783318 307157 start.go:134] duration metric: createHost completed in 8.417374876s
I0415 18:17:53.783337 307157 start.go:81] releasing machines lock for "stopped-upgrade-571200", held for 8.417532499s
	I0415 18:17:53.783414  307157 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-571200
                                                
                                                I0415 18:17:53.805243 307157 ssh_runner.go:195] Run: systemctl --version
I0415 18:17:53.805279 307157 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
	I0415 18:17:53.805299  307157 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-571200
                                                
                                                	I0415 18:17:53.805349  307157 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-571200
                                                
                                                	I0415 18:17:53.827560  307157 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33052 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/stopped-upgrade-571200/id_rsa Username:docker}
                                                
                                                	I0415 18:17:53.832395  307157 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33052 SSHKeyPath:/home/jenkins/minikube-integration/18634-7363/.minikube/machines/stopped-upgrade-571200/id_rsa Username:docker}
                                                
                                                I0415 18:17:53.915036 307157 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0415 18:17:53.937367 307157 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0415 18:17:53.937411 307157 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0415 18:17:53.946984 307157 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
image-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0415 18:17:53.960236 307157 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0415 18:17:54.055458 307157 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0415 18:17:54.140343 307157 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0415 18:17:54.217040 307157 ssh_runner.go:195] Run: sudo systemctl restart docker
==> Docker <==
-- Logs begin at Mon 2024-04-15 18:17:47 UTC, end at Mon 2024-04-15 18:17:54 UTC. --
Apr 15 18:17:53 missing-upgrade-047898 dockerd[992]: failed to create API server: Error reading X509 key pair (cert: "/etc/docker/server.pem", key: "/etc/docker/server-key.pem"): tls: private key does not match public key. Make sure the key is not encrypted.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 15 18:17:53 missing-upgrade-047898 systemd[1]: Failed to start Docker Application Container Engine.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: docker.service: Scheduled restart job, restart counter is at 2.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:54 missing-upgrade-047898 dockerd[1005]: time="2024-04-15T18:17:54.092288132Z" level=info msg="Starting up"
Apr 15 18:17:54 missing-upgrade-047898 dockerd[1005]: failed to create API server: Error reading X509 key pair (cert: "/etc/docker/server.pem", key: "/etc/docker/server-key.pem"): tls: private key does not match public key. Make sure the key is not encrypted.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: Failed to start Docker Application Container Engine.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: docker.service: Scheduled restart job, restart counter is at 3.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: Starting Docker Application Container Engine...
Apr 15 18:17:54 missing-upgrade-047898 dockerd[1023]: time="2024-04-15T18:17:54.305449583Z" level=info msg="Starting up"
Apr 15 18:17:54 missing-upgrade-047898 dockerd[1023]: failed to create API server: Error reading X509 key pair (cert: "/etc/docker/server.pem", key: "/etc/docker/server-key.pem"): tls: private key does not match public key. Make sure the key is not encrypted.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: Failed to start Docker Application Container Engine.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: docker.service: Scheduled restart job, restart counter is at 4.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: Stopped Docker Application Container Engine.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: docker.service: Start request repeated too quickly.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 15 18:17:54 missing-upgrade-047898 systemd[1]: Failed to start Docker Application Container Engine.
==> container status <==
command /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" failed with error: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": Process exited with status 1
stdout:
stderr:
time="2024-04-15T18:17:56Z" level=fatal msg="connect: connect endpoint 'unix:///var/run/cri-dockerd.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
==> describe nodes <==
command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
==> dmesg <==
[ +0.000018] ll header: 00000000: 02 42 2e f3 12 62 02 42 c0 a8 43 02 08 00
[ +0.000001] ll header: 00000000: 02 42 2e f3 12 62 02 42 c0 a8 43 02 08 00
[ +8.191243] IPv4: martian source 10.96.0.1 from 10.244.0.3, on dev br-38de591302a2
[ +0.000007] ll header: 00000000: 02 42 2e f3 12 62 02 42 c0 a8 43 02 08 00
[ -0.000001] IPv4: martian source 10.96.0.1 from 10.244.0.3, on dev br-38de591302a2
[ +0.000006] ll header: 00000000: 02 42 2e f3 12 62 02 42 c0 a8 43 02 08 00
[Apr15 18:09] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 62 85 80 da 55 80 08 06
[ +0.056303] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 2e 26 3c d4 b3 74 08 06
[Apr15 18:10] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 56 73 fe 3a e8 53 08 06
[Apr15 18:11] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff d6 2b 67 0a e0 9a 08 06
[Apr15 18:12] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 0a 85 a3 43 4c 96 08 06
[Apr15 18:14] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 2a d2 46 18 f2 82 08 06
[ +0.617051] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev bridge
[ +0.000016] ll header: 00000000: ff ff ff ff ff ff 36 f4 be ea bd ac 08 06
[ +0.501331] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 36 f4 be ea bd ac 08 06
[ +0.085971] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff d6 70 b8 bc f2 e2 08 06
[Apr15 18:16] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> kernel <==
18:17:57 up 1:00, 0 users, load average: 2.41, 2.90, 1.94
Linux missing-upgrade-047898 5.15.0-1055-gcp #63~20.04.1-Ubuntu SMP Wed Mar 20 14:40:47 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 20.04.4 LTS"
==> kubelet <==
-- Logs begin at Mon 2024-04-15 18:17:47 UTC, end at Mon 2024-04-15 18:17:57 UTC. --
-- No entries --
-- /stdout --
** stderr **
	E0415 18:17:54.635926  311126 logs.go:273] Failed to list containers for "kube-apiserver": docker: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}: Process exited with status 1
                                                
                                                stdout:
stderr:
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
	E0415 18:17:54.667735  311126 logs.go:273] Failed to list containers for "etcd": docker: docker ps -a --filter=name=k8s_etcd --format={{.ID}}: Process exited with status 1
                                                
                                                stdout:
stderr:
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
	E0415 18:17:54.700456  311126 logs.go:273] Failed to list containers for "coredns": docker: docker ps -a --filter=name=k8s_coredns --format={{.ID}}: Process exited with status 1
                                                
                                                stdout:
stderr:
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
	E0415 18:17:54.735173  311126 logs.go:273] Failed to list containers for "kube-scheduler": docker: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}: Process exited with status 1
                                                
                                                stdout:
stderr:
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
	E0415 18:17:54.768496  311126 logs.go:273] Failed to list containers for "kube-proxy": docker: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}: Process exited with status 1
                                                
                                                stdout:
stderr:
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
	E0415 18:17:54.805002  311126 logs.go:273] Failed to list containers for "kube-controller-manager": docker: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}: Process exited with status 1
                                                
                                                stdout:
stderr:
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
	E0415 18:17:54.839844  311126 logs.go:273] Failed to list containers for "kindnet": docker: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}: Process exited with status 1
                                                
                                                stdout:
stderr:
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
	E0415 18:17:54.874866  311126 logs.go:273] Failed to list containers for "storage-provisioner": docker: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}: Process exited with status 1
                                                
                                                stdout:
stderr:
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
** /stderr **
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p missing-upgrade-047898 -n missing-upgrade-047898
                                                
                                                helpers_test.go:254: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p missing-upgrade-047898 -n missing-upgrade-047898: exit status 2 (304.411068ms)
                                                
                                                -- stdout --
Stopped
-- /stdout --
helpers_test.go:254: status error: exit status 2 (may be ok)
helpers_test.go:256: "missing-upgrade-047898" apiserver is not running, skipping kubectl commands (state="Stopped")
helpers_test.go:175: Cleaning up "missing-upgrade-047898" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p missing-upgrade-047898
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p missing-upgrade-047898: (1.758012304s)
--- FAIL: TestMissingContainerUpgrade (138.82s)