=== RUN TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-amd64 start -p embed-certs-208903 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.28.1
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p embed-certs-208903 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.28.1: exit status 80 (5m54.478992142s)
-- stdout --
* [embed-certs-208903] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=17114
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17114-955377/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17114-955377/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on existing profile
* Starting control plane node embed-certs-208903 in cluster embed-certs-208903
* Restarting existing kvm2 VM for "embed-certs-208903" ...
* Updating the running kvm2 "embed-certs-208903" VM ...
-- /stdout --
** stderr **
I0830 22:13:56.716350 994705 out.go:296] Setting OutFile to fd 1 ...
I0830 22:13:56.716466 994705 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0830 22:13:56.716474 994705 out.go:309] Setting ErrFile to fd 2...
I0830 22:13:56.716478 994705 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0830 22:13:56.716683 994705 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17114-955377/.minikube/bin
I0830 22:13:56.717232 994705 out.go:303] Setting JSON to false
I0830 22:13:56.718196 994705 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-14","uptime":14184,"bootTime":1693419453,"procs":223,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0830 22:13:56.718268 994705 start.go:138] virtualization: kvm guest
I0830 22:13:56.721795 994705 out.go:177] * [embed-certs-208903] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
I0830 22:13:56.723387 994705 out.go:177] - MINIKUBE_LOCATION=17114
I0830 22:13:56.723479 994705 notify.go:220] Checking for updates...
I0830 22:13:56.724895 994705 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0830 22:13:56.726573 994705 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17114-955377/kubeconfig
I0830 22:13:56.728145 994705 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17114-955377/.minikube
I0830 22:13:56.729672 994705 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0830 22:13:56.731206 994705 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0830 22:13:56.733123 994705 config.go:182] Loaded profile config "embed-certs-208903": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.1
I0830 22:13:56.733478 994705 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0830 22:13:56.733544 994705 main.go:141] libmachine: Launching plugin server for driver kvm2
I0830 22:13:56.747823 994705 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42125
I0830 22:13:56.748205 994705 main.go:141] libmachine: () Calling .GetVersion
I0830 22:13:56.748900 994705 main.go:141] libmachine: Using API Version 1
I0830 22:13:56.748926 994705 main.go:141] libmachine: () Calling .SetConfigRaw
I0830 22:13:56.749267 994705 main.go:141] libmachine: () Calling .GetMachineName
I0830 22:13:56.749445 994705 main.go:141] libmachine: (embed-certs-208903) Calling .DriverName
I0830 22:13:56.749698 994705 driver.go:373] Setting default libvirt URI to qemu:///system
I0830 22:13:56.749970 994705 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0830 22:13:56.750003 994705 main.go:141] libmachine: Launching plugin server for driver kvm2
I0830 22:13:56.764216 994705 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40267
I0830 22:13:56.764575 994705 main.go:141] libmachine: () Calling .GetVersion
I0830 22:13:56.765009 994705 main.go:141] libmachine: Using API Version 1
I0830 22:13:56.765034 994705 main.go:141] libmachine: () Calling .SetConfigRaw
I0830 22:13:56.765403 994705 main.go:141] libmachine: () Calling .GetMachineName
I0830 22:13:56.765594 994705 main.go:141] libmachine: (embed-certs-208903) Calling .DriverName
I0830 22:13:56.798754 994705 out.go:177] * Using the kvm2 driver based on existing profile
I0830 22:13:56.800300 994705 start.go:298] selected driver: kvm2
I0830 22:13:56.800320 994705 start.go:902] validating driver "kvm2" against &{Name:embed-certs-208903 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17120/minikube-v1.31.0-1692872107-17120-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1692872184-17120@sha256:42602f0d347faca66d9347bdc33243fe5f4d6b3fff3ba53f3b2fc2d5fe63e9ec Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.1 ClusterName:embed-certs-208903 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.50.159 Port:8443 KubernetesVersion:v1.28.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDi
sks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
I0830 22:13:56.800474 994705 start.go:913] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0830 22:13:56.801339 994705 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0830 22:13:56.801411 994705 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17114-955377/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0830 22:13:56.816123 994705 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.31.2
I0830 22:13:56.816557 994705 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0830 22:13:56.816597 994705 cni.go:84] Creating CNI manager for ""
I0830 22:13:56.816609 994705 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0830 22:13:56.816629 994705 start_flags.go:319] config:
{Name:embed-certs-208903 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17120/minikube-v1.31.0-1692872107-17120-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1692872184-17120@sha256:42602f0d347faca66d9347bdc33243fe5f4d6b3fff3ba53f3b2fc2d5fe63e9ec Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:embed-certs-208903 Namespace:default A
PIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.50.159 Port:8443 KubernetesVersion:v1.28.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikub
e-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
I0830 22:13:56.816814 994705 iso.go:125] acquiring lock: {Name:mk46910f853d17f11045ef5235e32ef2f2012eaf Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0830 22:13:56.818991 994705 out.go:177] * Starting control plane node embed-certs-208903 in cluster embed-certs-208903
I0830 22:13:56.820639 994705 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime crio
I0830 22:13:56.820676 994705 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17114-955377/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-cri-o-overlay-amd64.tar.lz4
I0830 22:13:56.820686 994705 cache.go:57] Caching tarball of preloaded images
I0830 22:13:56.820764 994705 preload.go:174] Found /home/jenkins/minikube-integration/17114-955377/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0830 22:13:56.820809 994705 cache.go:60] Finished verifying existence of preloaded tar for v1.28.1 on crio
I0830 22:13:56.820935 994705 profile.go:148] Saving config to /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/embed-certs-208903/config.json ...
I0830 22:13:56.821141 994705 start.go:365] acquiring machines lock for embed-certs-208903: {Name:mke6a9629606c547866f9277d26981e565442e42 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0830 22:18:26.288205 994705 start.go:369] acquired machines lock for "embed-certs-208903" in 4m29.4670209s
I0830 22:18:26.288261 994705 start.go:96] Skipping create...Using existing machine configuration
I0830 22:18:26.288276 994705 fix.go:54] fixHost starting:
I0830 22:18:26.288621 994705 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0830 22:18:26.288656 994705 main.go:141] libmachine: Launching plugin server for driver kvm2
I0830 22:18:26.304048 994705 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37509
I0830 22:18:26.304613 994705 main.go:141] libmachine: () Calling .GetVersion
I0830 22:18:26.305138 994705 main.go:141] libmachine: Using API Version 1
I0830 22:18:26.305164 994705 main.go:141] libmachine: () Calling .SetConfigRaw
I0830 22:18:26.305518 994705 main.go:141] libmachine: () Calling .GetMachineName
I0830 22:18:26.305719 994705 main.go:141] libmachine: (embed-certs-208903) Calling .DriverName
I0830 22:18:26.305843 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetState
I0830 22:18:26.307597 994705 fix.go:102] recreateIfNeeded on embed-certs-208903: state=Stopped err=<nil>
I0830 22:18:26.307639 994705 main.go:141] libmachine: (embed-certs-208903) Calling .DriverName
W0830 22:18:26.307827 994705 fix.go:128] unexpected machine state, will restart: <nil>
I0830 22:18:26.309985 994705 out.go:177] * Restarting existing kvm2 VM for "embed-certs-208903" ...
I0830 22:18:26.311551 994705 main.go:141] libmachine: (embed-certs-208903) Calling .Start
I0830 22:18:26.311750 994705 main.go:141] libmachine: (embed-certs-208903) Ensuring networks are active...
I0830 22:18:26.312528 994705 main.go:141] libmachine: (embed-certs-208903) Ensuring network default is active
I0830 22:18:26.312814 994705 main.go:141] libmachine: (embed-certs-208903) Ensuring network mk-embed-certs-208903 is active
I0830 22:18:26.313153 994705 main.go:141] libmachine: (embed-certs-208903) Getting domain xml...
I0830 22:18:26.313857 994705 main.go:141] libmachine: (embed-certs-208903) Creating domain...
I0830 22:18:27.529120 994705 main.go:141] libmachine: (embed-certs-208903) Waiting to get IP...
I0830 22:18:27.530028 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:27.530390 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:27.530515 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:27.530404 996319 retry.go:31] will retry after 311.351139ms: waiting for machine to come up
I0830 22:18:27.843013 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:27.843398 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:27.843427 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:27.843337 996319 retry.go:31] will retry after 367.953943ms: waiting for machine to come up
I0830 22:18:28.213214 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:28.213785 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:28.213820 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:28.213722 996319 retry.go:31] will retry after 424.275825ms: waiting for machine to come up
I0830 22:18:28.639216 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:28.639670 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:28.639707 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:28.639609 996319 retry.go:31] will retry after 502.321201ms: waiting for machine to come up
I0830 22:18:29.143240 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:29.143823 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:29.143850 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:29.143790 996319 retry.go:31] will retry after 680.495047ms: waiting for machine to come up
I0830 22:18:29.825462 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:29.825879 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:29.825904 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:29.825836 996319 retry.go:31] will retry after 756.63617ms: waiting for machine to come up
I0830 22:18:30.583723 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:30.584179 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:30.584212 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:30.584118 996319 retry.go:31] will retry after 851.722792ms: waiting for machine to come up
I0830 22:18:31.437603 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:31.438031 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:31.438063 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:31.437986 996319 retry.go:31] will retry after 1.214893807s: waiting for machine to come up
I0830 22:18:32.654351 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:32.654803 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:32.654829 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:32.654756 996319 retry.go:31] will retry after 1.574180335s: waiting for machine to come up
I0830 22:18:34.231491 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:34.231911 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:34.231944 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:34.231826 996319 retry.go:31] will retry after 1.99107048s: waiting for machine to come up
I0830 22:18:36.225911 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:36.226336 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:36.226363 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:36.226283 996319 retry.go:31] will retry after 1.816508761s: waiting for machine to come up
I0830 22:18:38.044672 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:38.045061 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:38.045094 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:38.045021 996319 retry.go:31] will retry after 2.343148299s: waiting for machine to come up
I0830 22:18:40.389346 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:40.389753 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:40.389778 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:40.389700 996319 retry.go:31] will retry after 3.682098761s: waiting for machine to come up
I0830 22:18:44.074916 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.075386 994705 main.go:141] libmachine: (embed-certs-208903) Found IP for machine: 192.168.50.159
I0830 22:18:44.075411 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has current primary IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.075418 994705 main.go:141] libmachine: (embed-certs-208903) Reserving static IP address...
I0830 22:18:44.075899 994705 main.go:141] libmachine: (embed-certs-208903) Reserved static IP address: 192.168.50.159
I0830 22:18:44.075928 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "embed-certs-208903", mac: "52:54:00:07:50:90", ip: "192.168.50.159"} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.075939 994705 main.go:141] libmachine: (embed-certs-208903) Waiting for SSH to be available...
I0830 22:18:44.075959 994705 main.go:141] libmachine: (embed-certs-208903) DBG | skip adding static IP to network mk-embed-certs-208903 - found existing host DHCP lease matching {name: "embed-certs-208903", mac: "52:54:00:07:50:90", ip: "192.168.50.159"}
I0830 22:18:44.075968 994705 main.go:141] libmachine: (embed-certs-208903) DBG | Getting to WaitForSSH function...
I0830 22:18:44.078068 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.078390 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.078436 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.078514 994705 main.go:141] libmachine: (embed-certs-208903) DBG | Using SSH client type: external
I0830 22:18:44.078533 994705 main.go:141] libmachine: (embed-certs-208903) DBG | Using SSH private key: /home/jenkins/minikube-integration/17114-955377/.minikube/machines/embed-certs-208903/id_rsa (-rw-------)
I0830 22:18:44.078569 994705 main.go:141] libmachine: (embed-certs-208903) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.159 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17114-955377/.minikube/machines/embed-certs-208903/id_rsa -p 22] /usr/bin/ssh <nil>}
I0830 22:18:44.078590 994705 main.go:141] libmachine: (embed-certs-208903) DBG | About to run SSH command:
I0830 22:18:44.078622 994705 main.go:141] libmachine: (embed-certs-208903) DBG | exit 0
I0830 22:18:44.167514 994705 main.go:141] libmachine: (embed-certs-208903) DBG | SSH cmd err, output: <nil>:
I0830 22:18:44.167898 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetConfigRaw
I0830 22:18:44.168594 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetIP
I0830 22:18:44.170974 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.171336 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.171370 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.171696 994705 profile.go:148] Saving config to /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/embed-certs-208903/config.json ...
I0830 22:18:44.171967 994705 machine.go:88] provisioning docker machine ...
I0830 22:18:44.171989 994705 main.go:141] libmachine: (embed-certs-208903) Calling .DriverName
I0830 22:18:44.172184 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetMachineName
I0830 22:18:44.172371 994705 buildroot.go:166] provisioning hostname "embed-certs-208903"
I0830 22:18:44.172397 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetMachineName
I0830 22:18:44.172563 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:18:44.174522 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.174861 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.174894 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.174988 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:18:44.175159 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.175286 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.175413 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:18:44.175627 994705 main.go:141] libmachine: Using SSH client type: native
I0830 22:18:44.176111 994705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.50.159 22 <nil> <nil>}
I0830 22:18:44.176132 994705 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-208903 && echo "embed-certs-208903" | sudo tee /etc/hostname
I0830 22:18:44.309192 994705 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-208903
I0830 22:18:44.309225 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:18:44.311931 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.312327 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.312362 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.312512 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:18:44.312727 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.312919 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.313048 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:18:44.313215 994705 main.go:141] libmachine: Using SSH client type: native
I0830 22:18:44.313623 994705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.50.159 22 <nil> <nil>}
I0830 22:18:44.313638 994705 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-208903' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-208903/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-208903' | sudo tee -a /etc/hosts;
fi
fi
I0830 22:18:44.440529 994705 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0830 22:18:44.440594 994705 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17114-955377/.minikube CaCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17114-955377/.minikube}
I0830 22:18:44.440641 994705 buildroot.go:174] setting up certificates
I0830 22:18:44.440653 994705 provision.go:83] configureAuth start
I0830 22:18:44.440663 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetMachineName
I0830 22:18:44.440943 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetIP
I0830 22:18:44.443289 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.443663 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.443705 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.443805 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:18:44.445987 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.446297 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.446328 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.446462 994705 provision.go:138] copyHostCerts
I0830 22:18:44.446524 994705 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem, removing ...
I0830 22:18:44.446550 994705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem
I0830 22:18:44.446638 994705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem (1078 bytes)
I0830 22:18:44.446750 994705 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem, removing ...
I0830 22:18:44.446763 994705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem
I0830 22:18:44.446800 994705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem (1123 bytes)
I0830 22:18:44.446907 994705 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem, removing ...
I0830 22:18:44.446919 994705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem
I0830 22:18:44.446955 994705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem (1679 bytes)
I0830 22:18:44.447036 994705 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem org=jenkins.embed-certs-208903 san=[192.168.50.159 192.168.50.159 localhost 127.0.0.1 minikube embed-certs-208903]
I0830 22:18:44.664313 994705 provision.go:172] copyRemoteCerts
I0830 22:18:44.664387 994705 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0830 22:18:44.664434 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:18:44.666819 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.667160 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.667192 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.667338 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:18:44.667565 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.667687 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:18:44.667839 994705 sshutil.go:53] new ssh client: &{IP:192.168.50.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/embed-certs-208903/id_rsa Username:docker}
I0830 22:18:44.756922 994705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0830 22:18:44.780430 994705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem --> /etc/docker/server.pem (1229 bytes)
I0830 22:18:44.803396 994705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0830 22:18:44.825975 994705 provision.go:86] duration metric: configureAuth took 385.307932ms
I0830 22:18:44.826006 994705 buildroot.go:189] setting minikube options for container-runtime
I0830 22:18:44.826230 994705 config.go:182] Loaded profile config "embed-certs-208903": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.1
I0830 22:18:44.826334 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:18:44.828862 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.829199 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.829240 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.829383 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:18:44.829606 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.829770 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.829907 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:18:44.830104 994705 main.go:141] libmachine: Using SSH client type: native
I0830 22:18:44.830593 994705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.50.159 22 <nil> <nil>}
I0830 22:18:44.830615 994705 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0830 22:18:45.025539 994705 main.go:141] libmachine: SSH cmd err, output: Process exited with status 1:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
I0830 22:18:45.025585 994705 buildroot.go:191] Error setting container-runtime options during provisioning ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
I0830 22:18:45.025596 994705 machine.go:91] provisioned docker machine in 853.613637ms
I0830 22:18:45.025627 994705 fix.go:56] fixHost completed within 18.737351046s
I0830 22:18:45.025637 994705 start.go:83] releasing machines lock for "embed-certs-208903", held for 18.737393499s
W0830 22:18:45.025662 994705 start.go:672] error starting host: provision: ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
W0830 22:18:45.025746 994705 out.go:239] ! StartHost failed, but will try again: provision: ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
! StartHost failed, but will try again: provision: ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
I0830 22:18:45.025760 994705 start.go:687] Will try again in 5 seconds ...
I0830 22:18:50.028247 994705 start.go:365] acquiring machines lock for embed-certs-208903: {Name:mke6a9629606c547866f9277d26981e565442e42 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0830 22:19:50.136893 994705 start.go:369] acquired machines lock for "embed-certs-208903" in 1m0.108561967s
I0830 22:19:50.136941 994705 start.go:96] Skipping create...Using existing machine configuration
I0830 22:19:50.136952 994705 fix.go:54] fixHost starting:
I0830 22:19:50.137347 994705 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0830 22:19:50.137386 994705 main.go:141] libmachine: Launching plugin server for driver kvm2
I0830 22:19:50.156678 994705 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42209
I0830 22:19:50.157148 994705 main.go:141] libmachine: () Calling .GetVersion
I0830 22:19:50.157739 994705 main.go:141] libmachine: Using API Version 1
I0830 22:19:50.157765 994705 main.go:141] libmachine: () Calling .SetConfigRaw
I0830 22:19:50.158103 994705 main.go:141] libmachine: () Calling .GetMachineName
I0830 22:19:50.158283 994705 main.go:141] libmachine: (embed-certs-208903) Calling .DriverName
I0830 22:19:50.158445 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetState
I0830 22:19:50.160098 994705 fix.go:102] recreateIfNeeded on embed-certs-208903: state=Running err=<nil>
W0830 22:19:50.160115 994705 fix.go:128] unexpected machine state, will restart: <nil>
I0830 22:19:50.162162 994705 out.go:177] * Updating the running kvm2 "embed-certs-208903" VM ...
I0830 22:19:50.163634 994705 machine.go:88] provisioning docker machine ...
I0830 22:19:50.163663 994705 main.go:141] libmachine: (embed-certs-208903) Calling .DriverName
I0830 22:19:50.163906 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetMachineName
I0830 22:19:50.164077 994705 buildroot.go:166] provisioning hostname "embed-certs-208903"
I0830 22:19:50.164104 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetMachineName
I0830 22:19:50.164288 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:19:50.166831 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.167198 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:19:50.167234 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.167371 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:19:50.167561 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.167731 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.167902 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:19:50.168108 994705 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:50.168592 994705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.50.159 22 <nil> <nil>}
I0830 22:19:50.168610 994705 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-208903 && echo "embed-certs-208903" | sudo tee /etc/hostname
I0830 22:19:50.306738 994705 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-208903
I0830 22:19:50.306772 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:19:50.309523 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.309929 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:19:50.309974 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.310182 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:19:50.310349 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.310638 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.310845 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:19:50.311027 994705 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:50.311610 994705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.50.159 22 <nil> <nil>}
I0830 22:19:50.311644 994705 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-208903' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-208903/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-208903' | sudo tee -a /etc/hosts;
fi
fi
I0830 22:19:50.433972 994705 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0830 22:19:50.434005 994705 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17114-955377/.minikube CaCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17114-955377/.minikube}
I0830 22:19:50.434045 994705 buildroot.go:174] setting up certificates
I0830 22:19:50.434057 994705 provision.go:83] configureAuth start
I0830 22:19:50.434069 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetMachineName
I0830 22:19:50.434388 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetIP
I0830 22:19:50.437450 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.437883 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:19:50.437916 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.438115 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:19:50.440654 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.441014 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:19:50.441059 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.441213 994705 provision.go:138] copyHostCerts
I0830 22:19:50.441271 994705 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem, removing ...
I0830 22:19:50.441283 994705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem
I0830 22:19:50.441352 994705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem (1078 bytes)
I0830 22:19:50.441453 994705 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem, removing ...
I0830 22:19:50.441462 994705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem
I0830 22:19:50.441481 994705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem (1123 bytes)
I0830 22:19:50.441563 994705 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem, removing ...
I0830 22:19:50.441575 994705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem
I0830 22:19:50.441606 994705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem (1679 bytes)
I0830 22:19:50.441684 994705 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem org=jenkins.embed-certs-208903 san=[192.168.50.159 192.168.50.159 localhost 127.0.0.1 minikube embed-certs-208903]
I0830 22:19:50.721978 994705 provision.go:172] copyRemoteCerts
I0830 22:19:50.722039 994705 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0830 22:19:50.722072 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:19:50.724893 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.725257 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:19:50.725289 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.725571 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:19:50.725799 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.726014 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:19:50.726181 994705 sshutil.go:53] new ssh client: &{IP:192.168.50.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/embed-certs-208903/id_rsa Username:docker}
I0830 22:19:50.817217 994705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0830 22:19:50.843335 994705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem --> /etc/docker/server.pem (1229 bytes)
I0830 22:19:50.869233 994705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0830 22:19:50.897508 994705 provision.go:86] duration metric: configureAuth took 463.432948ms
I0830 22:19:50.897544 994705 buildroot.go:189] setting minikube options for container-runtime
I0830 22:19:50.897804 994705 config.go:182] Loaded profile config "embed-certs-208903": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.1
I0830 22:19:50.897904 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:19:50.900633 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.901014 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:19:50.901040 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.901210 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:19:50.901404 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.901547 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.901680 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:19:50.901875 994705 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:50.902287 994705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.50.159 22 <nil> <nil>}
I0830 22:19:50.902310 994705 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0830 22:19:51.128816 994705 main.go:141] libmachine: SSH cmd err, output: Process exited with status 1:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
I0830 22:19:51.128855 994705 buildroot.go:191] Error setting container-runtime options during provisioning ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
I0830 22:19:51.128866 994705 machine.go:91] provisioned docker machine in 965.212906ms
I0830 22:19:51.128900 994705 fix.go:56] fixHost completed within 991.948899ms
I0830 22:19:51.128906 994705 start.go:83] releasing machines lock for "embed-certs-208903", held for 991.990648ms
W0830 22:19:51.129050 994705 out.go:239] * Failed to start kvm2 VM. Running "minikube delete -p embed-certs-208903" may fix it: provision: ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
* Failed to start kvm2 VM. Running "minikube delete -p embed-certs-208903" may fix it: provision: ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
I0830 22:19:51.131823 994705 out.go:177]
W0830 22:19:51.133957 994705 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: provision: ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: provision: ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
W0830 22:19:51.133985 994705 out.go:239] *
*
W0830 22:19:51.134788 994705 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0830 22:19:51.136212 994705 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-amd64 start -p embed-certs-208903 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.28.1": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-208903 -n embed-certs-208903
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-208903 -n embed-certs-208903: exit status 2 (276.997412ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:239: status error: exit status 2 (may be ok)
helpers_test.go:244: <<< TestStartStop/group/embed-certs/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/embed-certs/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p embed-certs-208903 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p embed-certs-208903 logs -n 25: (54.88776789s)
helpers_test.go:252: TestStartStop/group/embed-certs/serial/SecondStart logs:
-- stdout --
*
* ==> Audit <==
* |---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cert-options-519738 -- sudo | cert-options-519738 | jenkins | v1.31.2 | 30 Aug 23 22:08 UTC | 30 Aug 23 22:08 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-519738 | cert-options-519738 | jenkins | v1.31.2 | 30 Aug 23 22:08 UTC | 30 Aug 23 22:08 UTC |
| start | -p no-preload-698195 | no-preload-698195 | jenkins | v1.31.2 | 30 Aug 23 22:08 UTC | 30 Aug 23 22:11 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.1 | | | | | |
| delete | -p stopped-upgrade-184733 | stopped-upgrade-184733 | jenkins | v1.31.2 | 30 Aug 23 22:09 UTC | 30 Aug 23 22:09 UTC |
| start | -p embed-certs-208903 | embed-certs-208903 | jenkins | v1.31.2 | 30 Aug 23 22:09 UTC | 30 Aug 23 22:11 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.1 | | | | | |
| start | -p cert-expiration-693390 | cert-expiration-693390 | jenkins | v1.31.2 | 30 Aug 23 22:10 UTC | 30 Aug 23 22:10 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p cert-expiration-693390 | cert-expiration-693390 | jenkins | v1.31.2 | 30 Aug 23 22:10 UTC | 30 Aug 23 22:10 UTC |
| delete | -p | disable-driver-mounts-883991 | jenkins | v1.31.2 | 30 Aug 23 22:10 UTC | 30 Aug 23 22:10 UTC |
| | disable-driver-mounts-883991 | | | | | |
| start | -p | default-k8s-diff-port-791007 | jenkins | v1.31.2 | 30 Aug 23 22:10 UTC | 30 Aug 23 22:12 UTC |
| | default-k8s-diff-port-791007 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.1 | | | | | |
| addons | enable metrics-server -p no-preload-698195 | no-preload-698195 | jenkins | v1.31.2 | 30 Aug 23 22:11 UTC | 30 Aug 23 22:11 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-698195 | no-preload-698195 | jenkins | v1.31.2 | 30 Aug 23 22:11 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p embed-certs-208903 | embed-certs-208903 | jenkins | v1.31.2 | 30 Aug 23 22:11 UTC | 30 Aug 23 22:11 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-208903 | embed-certs-208903 | jenkins | v1.31.2 | 30 Aug 23 22:11 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p default-k8s-diff-port-791007 | default-k8s-diff-port-791007 | jenkins | v1.31.2 | 30 Aug 23 22:12 UTC | 30 Aug 23 22:12 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | default-k8s-diff-port-791007 | jenkins | v1.31.2 | 30 Aug 23 22:12 UTC | |
| | default-k8s-diff-port-791007 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-698195 | no-preload-698195 | jenkins | v1.31.2 | 30 Aug 23 22:13 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| addons | enable dashboard -p embed-certs-208903 | embed-certs-208903 | jenkins | v1.31.2 | 30 Aug 23 22:13 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-698195 | no-preload-698195 | jenkins | v1.31.2 | 30 Aug 23 22:13 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.1 | | | | | |
| start | -p embed-certs-208903 | embed-certs-208903 | jenkins | v1.31.2 | 30 Aug 23 22:13 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.1 | | | | | |
| addons | enable metrics-server -p old-k8s-version-250163 | old-k8s-version-250163 | jenkins | v1.31.2 | 30 Aug 23 22:14 UTC | 30 Aug 23 22:14 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-250163 | old-k8s-version-250163 | jenkins | v1.31.2 | 30 Aug 23 22:14 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p default-k8s-diff-port-791007 | default-k8s-diff-port-791007 | jenkins | v1.31.2 | 30 Aug 23 22:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p | default-k8s-diff-port-791007 | jenkins | v1.31.2 | 30 Aug 23 22:15 UTC | |
| | default-k8s-diff-port-791007 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.1 | | | | | |
| addons | enable dashboard -p old-k8s-version-250163 | old-k8s-version-250163 | jenkins | v1.31.2 | 30 Aug 23 22:16 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-250163 | old-k8s-version-250163 | jenkins | v1.31.2 | 30 Aug 23 22:16 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
*
* ==> Last Start <==
* Log file created at: 2023/08/30 22:16:59
Running on machine: ubuntu-20-agent-14
Binary: Built with gc go1.20.7 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0830 22:16:59.758341 995603 out.go:296] Setting OutFile to fd 1 ...
I0830 22:16:59.758470 995603 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0830 22:16:59.758479 995603 out.go:309] Setting ErrFile to fd 2...
I0830 22:16:59.758484 995603 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0830 22:16:59.758692 995603 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17114-955377/.minikube/bin
I0830 22:16:59.759241 995603 out.go:303] Setting JSON to false
I0830 22:16:59.760232 995603 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-14","uptime":14367,"bootTime":1693419453,"procs":205,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0830 22:16:59.760291 995603 start.go:138] virtualization: kvm guest
I0830 22:16:59.762744 995603 out.go:177] * [old-k8s-version-250163] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
I0830 22:16:59.764395 995603 out.go:177] - MINIKUBE_LOCATION=17114
I0830 22:16:59.765863 995603 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0830 22:16:59.764404 995603 notify.go:220] Checking for updates...
I0830 22:16:59.767579 995603 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17114-955377/kubeconfig
I0830 22:16:59.769244 995603 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17114-955377/.minikube
I0830 22:16:59.771001 995603 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0830 22:16:59.772625 995603 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0830 22:16:59.774574 995603 config.go:182] Loaded profile config "old-k8s-version-250163": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0830 22:16:59.774929 995603 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0830 22:16:59.775032 995603 main.go:141] libmachine: Launching plugin server for driver kvm2
I0830 22:16:59.790271 995603 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43163
I0830 22:16:59.790677 995603 main.go:141] libmachine: () Calling .GetVersion
I0830 22:16:59.791257 995603 main.go:141] libmachine: Using API Version 1
I0830 22:16:59.791283 995603 main.go:141] libmachine: () Calling .SetConfigRaw
I0830 22:16:59.791645 995603 main.go:141] libmachine: () Calling .GetMachineName
I0830 22:16:59.791879 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .DriverName
I0830 22:16:59.793885 995603 out.go:177] * Kubernetes 1.28.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.1
I0830 22:16:59.795414 995603 driver.go:373] Setting default libvirt URI to qemu:///system
I0830 22:16:59.795716 995603 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0830 22:16:59.795752 995603 main.go:141] libmachine: Launching plugin server for driver kvm2
I0830 22:16:59.810316 995603 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35461
I0830 22:16:59.810694 995603 main.go:141] libmachine: () Calling .GetVersion
I0830 22:16:59.811176 995603 main.go:141] libmachine: Using API Version 1
I0830 22:16:59.811201 995603 main.go:141] libmachine: () Calling .SetConfigRaw
I0830 22:16:59.811560 995603 main.go:141] libmachine: () Calling .GetMachineName
I0830 22:16:59.811808 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .DriverName
I0830 22:16:59.845962 995603 out.go:177] * Using the kvm2 driver based on existing profile
I0830 22:16:59.847399 995603 start.go:298] selected driver: kvm2
I0830 22:16:59.847410 995603 start.go:902] validating driver "kvm2" against &{Name:old-k8s-version-250163 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17120/minikube-v1.31.0-1692872107-17120-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1692872184-17120@sha256:42602f0d347faca66d9347bdc33243fe5f4d6b3fff3ba53f3b2fc2d5fe63e9ec Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-250163 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.10 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false
ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
I0830 22:16:59.847546 995603 start.go:913] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0830 22:16:59.848301 995603 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0830 22:16:59.848376 995603 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17114-955377/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0830 22:16:59.862654 995603 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.31.2
I0830 22:16:59.863040 995603 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0830 22:16:59.863080 995603 cni.go:84] Creating CNI manager for ""
I0830 22:16:59.863094 995603 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0830 22:16:59.863109 995603 start_flags.go:319] config:
{Name:old-k8s-version-250163 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17120/minikube-v1.31.0-1692872107-17120-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1692872184-17120@sha256:42602f0d347faca66d9347bdc33243fe5f4d6b3fff3ba53f3b2fc2d5fe63e9ec Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-250163 Namespace:d
efault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.10 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/
minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
I0830 22:16:59.863341 995603 iso.go:125] acquiring lock: {Name:mk46910f853d17f11045ef5235e32ef2f2012eaf Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0830 22:16:59.865500 995603 out.go:177] * Starting control plane node old-k8s-version-250163 in cluster old-k8s-version-250163
I0830 22:17:00.916070 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:16:59.866763 995603 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0830 22:16:59.866836 995603 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17114-955377/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4
I0830 22:16:59.866852 995603 cache.go:57] Caching tarball of preloaded images
I0830 22:16:59.866935 995603 preload.go:174] Found /home/jenkins/minikube-integration/17114-955377/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0830 22:16:59.866946 995603 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on crio
I0830 22:16:59.867091 995603 profile.go:148] Saving config to /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/old-k8s-version-250163/config.json ...
I0830 22:16:59.867314 995603 start.go:365] acquiring machines lock for old-k8s-version-250163: {Name:mke6a9629606c547866f9277d26981e565442e42 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0830 22:17:06.996025 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:17:10.068036 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:17:16.148043 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:17:19.220024 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:17:25.300036 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:17:28.372088 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:17:34.452043 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:17:37.524037 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:17:43.604037 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:17:46.676107 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:17:52.756100 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:17:55.828195 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:18:01.908025 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:18:04.980079 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:18:11.060035 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:18:14.132025 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:18:20.212050 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:18:23.283995 994624 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.28:22: connect: no route to host
I0830 22:18:26.288205 994705 start.go:369] acquired machines lock for "embed-certs-208903" in 4m29.4670209s
I0830 22:18:26.288261 994705 start.go:96] Skipping create...Using existing machine configuration
I0830 22:18:26.288276 994705 fix.go:54] fixHost starting:
I0830 22:18:26.288621 994705 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0830 22:18:26.288656 994705 main.go:141] libmachine: Launching plugin server for driver kvm2
I0830 22:18:26.304048 994705 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37509
I0830 22:18:26.304613 994705 main.go:141] libmachine: () Calling .GetVersion
I0830 22:18:26.305138 994705 main.go:141] libmachine: Using API Version 1
I0830 22:18:26.305164 994705 main.go:141] libmachine: () Calling .SetConfigRaw
I0830 22:18:26.305518 994705 main.go:141] libmachine: () Calling .GetMachineName
I0830 22:18:26.305719 994705 main.go:141] libmachine: (embed-certs-208903) Calling .DriverName
I0830 22:18:26.305843 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetState
I0830 22:18:26.307597 994705 fix.go:102] recreateIfNeeded on embed-certs-208903: state=Stopped err=<nil>
I0830 22:18:26.307639 994705 main.go:141] libmachine: (embed-certs-208903) Calling .DriverName
W0830 22:18:26.307827 994705 fix.go:128] unexpected machine state, will restart: <nil>
I0830 22:18:26.309985 994705 out.go:177] * Restarting existing kvm2 VM for "embed-certs-208903" ...
I0830 22:18:26.311551 994705 main.go:141] libmachine: (embed-certs-208903) Calling .Start
I0830 22:18:26.311750 994705 main.go:141] libmachine: (embed-certs-208903) Ensuring networks are active...
I0830 22:18:26.312528 994705 main.go:141] libmachine: (embed-certs-208903) Ensuring network default is active
I0830 22:18:26.312814 994705 main.go:141] libmachine: (embed-certs-208903) Ensuring network mk-embed-certs-208903 is active
I0830 22:18:26.313153 994705 main.go:141] libmachine: (embed-certs-208903) Getting domain xml...
I0830 22:18:26.313857 994705 main.go:141] libmachine: (embed-certs-208903) Creating domain...
I0830 22:18:26.285881 994624 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0830 22:18:26.285939 994624 main.go:141] libmachine: (no-preload-698195) Calling .GetSSHHostname
I0830 22:18:26.288013 994624 machine.go:91] provisioned docker machine in 4m37.410947228s
I0830 22:18:26.288063 994624 fix.go:56] fixHost completed within 4m37.432260867s
I0830 22:18:26.288085 994624 start.go:83] releasing machines lock for "no-preload-698195", held for 4m37.432330775s
W0830 22:18:26.288107 994624 start.go:672] error starting host: provision: host is not running
W0830 22:18:26.288219 994624 out.go:239] ! StartHost failed, but will try again: provision: host is not running
I0830 22:18:26.288225 994624 start.go:687] Will try again in 5 seconds ...
I0830 22:18:27.529120 994705 main.go:141] libmachine: (embed-certs-208903) Waiting to get IP...
I0830 22:18:27.530028 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:27.530390 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:27.530515 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:27.530404 996319 retry.go:31] will retry after 311.351139ms: waiting for machine to come up
I0830 22:18:27.843013 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:27.843398 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:27.843427 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:27.843337 996319 retry.go:31] will retry after 367.953943ms: waiting for machine to come up
I0830 22:18:28.213214 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:28.213785 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:28.213820 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:28.213722 996319 retry.go:31] will retry after 424.275825ms: waiting for machine to come up
I0830 22:18:28.639216 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:28.639670 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:28.639707 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:28.639609 996319 retry.go:31] will retry after 502.321201ms: waiting for machine to come up
I0830 22:18:29.143240 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:29.143823 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:29.143850 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:29.143790 996319 retry.go:31] will retry after 680.495047ms: waiting for machine to come up
I0830 22:18:29.825462 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:29.825879 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:29.825904 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:29.825836 996319 retry.go:31] will retry after 756.63617ms: waiting for machine to come up
I0830 22:18:30.583723 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:30.584179 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:30.584212 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:30.584118 996319 retry.go:31] will retry after 851.722792ms: waiting for machine to come up
I0830 22:18:31.437603 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:31.438031 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:31.438063 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:31.437986 996319 retry.go:31] will retry after 1.214893807s: waiting for machine to come up
I0830 22:18:31.289961 994624 start.go:365] acquiring machines lock for no-preload-698195: {Name:mke6a9629606c547866f9277d26981e565442e42 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0830 22:18:32.654351 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:32.654803 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:32.654829 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:32.654756 996319 retry.go:31] will retry after 1.574180335s: waiting for machine to come up
I0830 22:18:34.231491 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:34.231911 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:34.231944 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:34.231826 996319 retry.go:31] will retry after 1.99107048s: waiting for machine to come up
I0830 22:18:36.225911 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:36.226336 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:36.226363 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:36.226283 996319 retry.go:31] will retry after 1.816508761s: waiting for machine to come up
I0830 22:18:38.044672 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:38.045061 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:38.045094 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:38.045021 996319 retry.go:31] will retry after 2.343148299s: waiting for machine to come up
I0830 22:18:40.389346 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:40.389753 994705 main.go:141] libmachine: (embed-certs-208903) DBG | unable to find current IP address of domain embed-certs-208903 in network mk-embed-certs-208903
I0830 22:18:40.389778 994705 main.go:141] libmachine: (embed-certs-208903) DBG | I0830 22:18:40.389700 996319 retry.go:31] will retry after 3.682098761s: waiting for machine to come up
I0830 22:18:45.025750 995192 start.go:369] acquired machines lock for "default-k8s-diff-port-791007" in 3m32.939054887s
I0830 22:18:45.025823 995192 start.go:96] Skipping create...Using existing machine configuration
I0830 22:18:45.025847 995192 fix.go:54] fixHost starting:
I0830 22:18:45.026291 995192 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0830 22:18:45.026333 995192 main.go:141] libmachine: Launching plugin server for driver kvm2
I0830 22:18:45.041161 995192 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33625
I0830 22:18:45.041657 995192 main.go:141] libmachine: () Calling .GetVersion
I0830 22:18:45.042176 995192 main.go:141] libmachine: Using API Version 1
I0830 22:18:45.042208 995192 main.go:141] libmachine: () Calling .SetConfigRaw
I0830 22:18:45.042544 995192 main.go:141] libmachine: () Calling .GetMachineName
I0830 22:18:45.042748 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .DriverName
I0830 22:18:45.042910 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetState
I0830 22:18:45.044428 995192 fix.go:102] recreateIfNeeded on default-k8s-diff-port-791007: state=Stopped err=<nil>
I0830 22:18:45.044454 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .DriverName
W0830 22:18:45.044615 995192 fix.go:128] unexpected machine state, will restart: <nil>
I0830 22:18:45.046538 995192 out.go:177] * Restarting existing kvm2 VM for "default-k8s-diff-port-791007" ...
I0830 22:18:44.074916 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.075386 994705 main.go:141] libmachine: (embed-certs-208903) Found IP for machine: 192.168.50.159
I0830 22:18:44.075411 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has current primary IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.075418 994705 main.go:141] libmachine: (embed-certs-208903) Reserving static IP address...
I0830 22:18:44.075899 994705 main.go:141] libmachine: (embed-certs-208903) Reserved static IP address: 192.168.50.159
I0830 22:18:44.075928 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "embed-certs-208903", mac: "52:54:00:07:50:90", ip: "192.168.50.159"} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.075939 994705 main.go:141] libmachine: (embed-certs-208903) Waiting for SSH to be available...
I0830 22:18:44.075959 994705 main.go:141] libmachine: (embed-certs-208903) DBG | skip adding static IP to network mk-embed-certs-208903 - found existing host DHCP lease matching {name: "embed-certs-208903", mac: "52:54:00:07:50:90", ip: "192.168.50.159"}
I0830 22:18:44.075968 994705 main.go:141] libmachine: (embed-certs-208903) DBG | Getting to WaitForSSH function...
I0830 22:18:44.078068 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.078390 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.078436 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.078514 994705 main.go:141] libmachine: (embed-certs-208903) DBG | Using SSH client type: external
I0830 22:18:44.078533 994705 main.go:141] libmachine: (embed-certs-208903) DBG | Using SSH private key: /home/jenkins/minikube-integration/17114-955377/.minikube/machines/embed-certs-208903/id_rsa (-rw-------)
I0830 22:18:44.078569 994705 main.go:141] libmachine: (embed-certs-208903) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.159 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17114-955377/.minikube/machines/embed-certs-208903/id_rsa -p 22] /usr/bin/ssh <nil>}
I0830 22:18:44.078590 994705 main.go:141] libmachine: (embed-certs-208903) DBG | About to run SSH command:
I0830 22:18:44.078622 994705 main.go:141] libmachine: (embed-certs-208903) DBG | exit 0
I0830 22:18:44.167514 994705 main.go:141] libmachine: (embed-certs-208903) DBG | SSH cmd err, output: <nil>:
I0830 22:18:44.167898 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetConfigRaw
I0830 22:18:44.168594 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetIP
I0830 22:18:44.170974 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.171336 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.171370 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.171696 994705 profile.go:148] Saving config to /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/embed-certs-208903/config.json ...
I0830 22:18:44.171967 994705 machine.go:88] provisioning docker machine ...
I0830 22:18:44.171989 994705 main.go:141] libmachine: (embed-certs-208903) Calling .DriverName
I0830 22:18:44.172184 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetMachineName
I0830 22:18:44.172371 994705 buildroot.go:166] provisioning hostname "embed-certs-208903"
I0830 22:18:44.172397 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetMachineName
I0830 22:18:44.172563 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:18:44.174522 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.174861 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.174894 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.174988 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:18:44.175159 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.175286 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.175413 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:18:44.175627 994705 main.go:141] libmachine: Using SSH client type: native
I0830 22:18:44.176111 994705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.50.159 22 <nil> <nil>}
I0830 22:18:44.176132 994705 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-208903 && echo "embed-certs-208903" | sudo tee /etc/hostname
I0830 22:18:44.309192 994705 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-208903
I0830 22:18:44.309225 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:18:44.311931 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.312327 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.312362 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.312512 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:18:44.312727 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.312919 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.313048 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:18:44.313215 994705 main.go:141] libmachine: Using SSH client type: native
I0830 22:18:44.313623 994705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.50.159 22 <nil> <nil>}
I0830 22:18:44.313638 994705 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-208903' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-208903/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-208903' | sudo tee -a /etc/hosts;
fi
fi
I0830 22:18:44.440529 994705 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0830 22:18:44.440594 994705 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17114-955377/.minikube CaCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17114-955377/.minikube}
I0830 22:18:44.440641 994705 buildroot.go:174] setting up certificates
I0830 22:18:44.440653 994705 provision.go:83] configureAuth start
I0830 22:18:44.440663 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetMachineName
I0830 22:18:44.440943 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetIP
I0830 22:18:44.443289 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.443663 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.443705 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.443805 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:18:44.445987 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.446297 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.446328 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.446462 994705 provision.go:138] copyHostCerts
I0830 22:18:44.446524 994705 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem, removing ...
I0830 22:18:44.446550 994705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem
I0830 22:18:44.446638 994705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem (1078 bytes)
I0830 22:18:44.446750 994705 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem, removing ...
I0830 22:18:44.446763 994705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem
I0830 22:18:44.446800 994705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem (1123 bytes)
I0830 22:18:44.446907 994705 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem, removing ...
I0830 22:18:44.446919 994705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem
I0830 22:18:44.446955 994705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem (1679 bytes)
I0830 22:18:44.447036 994705 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem org=jenkins.embed-certs-208903 san=[192.168.50.159 192.168.50.159 localhost 127.0.0.1 minikube embed-certs-208903]
I0830 22:18:44.664313 994705 provision.go:172] copyRemoteCerts
I0830 22:18:44.664387 994705 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0830 22:18:44.664434 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:18:44.666819 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.667160 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.667192 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.667338 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:18:44.667565 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.667687 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:18:44.667839 994705 sshutil.go:53] new ssh client: &{IP:192.168.50.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/embed-certs-208903/id_rsa Username:docker}
I0830 22:18:44.756922 994705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0830 22:18:44.780430 994705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem --> /etc/docker/server.pem (1229 bytes)
I0830 22:18:44.803396 994705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0830 22:18:44.825975 994705 provision.go:86] duration metric: configureAuth took 385.307932ms
I0830 22:18:44.826006 994705 buildroot.go:189] setting minikube options for container-runtime
I0830 22:18:44.826230 994705 config.go:182] Loaded profile config "embed-certs-208903": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.1
I0830 22:18:44.826334 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:18:44.828862 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.829199 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:18:44.829240 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:18:44.829383 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:18:44.829606 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.829770 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:18:44.829907 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:18:44.830104 994705 main.go:141] libmachine: Using SSH client type: native
I0830 22:18:44.830593 994705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.50.159 22 <nil> <nil>}
I0830 22:18:44.830615 994705 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0830 22:18:45.025539 994705 main.go:141] libmachine: SSH cmd err, output: Process exited with status 1:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
I0830 22:18:45.025585 994705 buildroot.go:191] Error setting container-runtime options during provisioning ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
I0830 22:18:45.025596 994705 machine.go:91] provisioned docker machine in 853.613637ms
I0830 22:18:45.025627 994705 fix.go:56] fixHost completed within 18.737351046s
I0830 22:18:45.025637 994705 start.go:83] releasing machines lock for "embed-certs-208903", held for 18.737393499s
W0830 22:18:45.025662 994705 start.go:672] error starting host: provision: ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
W0830 22:18:45.025746 994705 out.go:239] ! StartHost failed, but will try again: provision: ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
I0830 22:18:45.025760 994705 start.go:687] Will try again in 5 seconds ...
I0830 22:18:45.047821 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .Start
I0830 22:18:45.047982 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Ensuring networks are active...
I0830 22:18:45.048684 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Ensuring network default is active
I0830 22:18:45.049040 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Ensuring network mk-default-k8s-diff-port-791007 is active
I0830 22:18:45.049401 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Getting domain xml...
I0830 22:18:45.050009 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Creating domain...
I0830 22:18:46.288943 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Waiting to get IP...
I0830 22:18:46.289982 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:18:46.290359 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | unable to find current IP address of domain default-k8s-diff-port-791007 in network mk-default-k8s-diff-port-791007
I0830 22:18:46.290494 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | I0830 22:18:46.290388 996430 retry.go:31] will retry after 228.105709ms: waiting for machine to come up
I0830 22:18:46.519862 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:18:46.520369 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | unable to find current IP address of domain default-k8s-diff-port-791007 in network mk-default-k8s-diff-port-791007
I0830 22:18:46.520389 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | I0830 22:18:46.520342 996430 retry.go:31] will retry after 343.008473ms: waiting for machine to come up
I0830 22:18:46.865023 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:18:46.865426 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | unable to find current IP address of domain default-k8s-diff-port-791007 in network mk-default-k8s-diff-port-791007
I0830 22:18:46.865468 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | I0830 22:18:46.865385 996430 retry.go:31] will retry after 467.017605ms: waiting for machine to come up
I0830 22:18:50.028247 994705 start.go:365] acquiring machines lock for embed-certs-208903: {Name:mke6a9629606c547866f9277d26981e565442e42 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0830 22:18:47.334027 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:18:47.334655 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | unable to find current IP address of domain default-k8s-diff-port-791007 in network mk-default-k8s-diff-port-791007
I0830 22:18:47.334682 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | I0830 22:18:47.334600 996430 retry.go:31] will retry after 601.952764ms: waiting for machine to come up
I0830 22:18:47.937980 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:18:47.938454 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | unable to find current IP address of domain default-k8s-diff-port-791007 in network mk-default-k8s-diff-port-791007
I0830 22:18:47.938494 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | I0830 22:18:47.938387 996430 retry.go:31] will retry after 556.18277ms: waiting for machine to come up
I0830 22:18:48.495747 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:18:48.496130 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | unable to find current IP address of domain default-k8s-diff-port-791007 in network mk-default-k8s-diff-port-791007
I0830 22:18:48.496184 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | I0830 22:18:48.496101 996430 retry.go:31] will retry after 696.126701ms: waiting for machine to come up
I0830 22:18:49.193405 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:18:49.193789 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | unable to find current IP address of domain default-k8s-diff-port-791007 in network mk-default-k8s-diff-port-791007
I0830 22:18:49.193822 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | I0830 22:18:49.193752 996430 retry.go:31] will retry after 1.123021492s: waiting for machine to come up
I0830 22:18:50.318326 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:18:50.318682 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | unable to find current IP address of domain default-k8s-diff-port-791007 in network mk-default-k8s-diff-port-791007
I0830 22:18:50.318710 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | I0830 22:18:50.318637 996430 retry.go:31] will retry after 1.198520166s: waiting for machine to come up
I0830 22:18:51.518959 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:18:51.519302 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | unable to find current IP address of domain default-k8s-diff-port-791007 in network mk-default-k8s-diff-port-791007
I0830 22:18:51.519332 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | I0830 22:18:51.519244 996430 retry.go:31] will retry after 1.851352392s: waiting for machine to come up
I0830 22:18:53.373208 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:18:53.373676 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | unable to find current IP address of domain default-k8s-diff-port-791007 in network mk-default-k8s-diff-port-791007
I0830 22:18:53.373713 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | I0830 22:18:53.373594 996430 retry.go:31] will retry after 1.789163964s: waiting for machine to come up
I0830 22:18:55.164132 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:18:55.164634 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | unable to find current IP address of domain default-k8s-diff-port-791007 in network mk-default-k8s-diff-port-791007
I0830 22:18:55.164664 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | I0830 22:18:55.164587 996430 retry.go:31] will retry after 2.037803279s: waiting for machine to come up
I0830 22:18:57.204503 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:18:57.204957 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | unable to find current IP address of domain default-k8s-diff-port-791007 in network mk-default-k8s-diff-port-791007
I0830 22:18:57.204984 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | I0830 22:18:57.204919 996430 retry.go:31] will retry after 3.365492251s: waiting for machine to come up
I0830 22:19:00.572195 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:00.572595 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | unable to find current IP address of domain default-k8s-diff-port-791007 in network mk-default-k8s-diff-port-791007
I0830 22:19:00.572634 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | I0830 22:19:00.572533 996430 retry.go:31] will retry after 3.57478782s: waiting for machine to come up
I0830 22:19:05.536665 995603 start.go:369] acquired machines lock for "old-k8s-version-250163" in 2m5.669275373s
I0830 22:19:05.536730 995603 start.go:96] Skipping create...Using existing machine configuration
I0830 22:19:05.536751 995603 fix.go:54] fixHost starting:
I0830 22:19:05.537197 995603 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0830 22:19:05.537240 995603 main.go:141] libmachine: Launching plugin server for driver kvm2
I0830 22:19:05.556581 995603 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41089
I0830 22:19:05.557016 995603 main.go:141] libmachine: () Calling .GetVersion
I0830 22:19:05.557559 995603 main.go:141] libmachine: Using API Version 1
I0830 22:19:05.557590 995603 main.go:141] libmachine: () Calling .SetConfigRaw
I0830 22:19:05.557937 995603 main.go:141] libmachine: () Calling .GetMachineName
I0830 22:19:05.558124 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .DriverName
I0830 22:19:05.558290 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetState
I0830 22:19:05.559829 995603 fix.go:102] recreateIfNeeded on old-k8s-version-250163: state=Stopped err=<nil>
I0830 22:19:05.559871 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .DriverName
W0830 22:19:05.560056 995603 fix.go:128] unexpected machine state, will restart: <nil>
I0830 22:19:05.562726 995603 out.go:177] * Restarting existing kvm2 VM for "old-k8s-version-250163" ...
I0830 22:19:04.151280 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.151787 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Found IP for machine: 192.168.61.104
I0830 22:19:04.151820 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Reserving static IP address...
I0830 22:19:04.151839 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has current primary IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.152254 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "default-k8s-diff-port-791007", mac: "52:54:00:1e:2e:1e", ip: "192.168.61.104"} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:04.152286 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Reserved static IP address: 192.168.61.104
I0830 22:19:04.152306 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | skip adding static IP to network mk-default-k8s-diff-port-791007 - found existing host DHCP lease matching {name: "default-k8s-diff-port-791007", mac: "52:54:00:1e:2e:1e", ip: "192.168.61.104"}
I0830 22:19:04.152324 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Waiting for SSH to be available...
I0830 22:19:04.152339 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | Getting to WaitForSSH function...
I0830 22:19:04.154335 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.154667 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:04.154701 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.154791 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | Using SSH client type: external
I0830 22:19:04.154833 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | Using SSH private key: /home/jenkins/minikube-integration/17114-955377/.minikube/machines/default-k8s-diff-port-791007/id_rsa (-rw-------)
I0830 22:19:04.154852 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.104 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17114-955377/.minikube/machines/default-k8s-diff-port-791007/id_rsa -p 22] /usr/bin/ssh <nil>}
I0830 22:19:04.154868 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | About to run SSH command:
I0830 22:19:04.154879 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | exit 0
I0830 22:19:04.251692 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | SSH cmd err, output: <nil>:
I0830 22:19:04.252182 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetConfigRaw
I0830 22:19:04.252842 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetIP
I0830 22:19:04.255184 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.255536 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:04.255571 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.255850 995192 profile.go:148] Saving config to /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/default-k8s-diff-port-791007/config.json ...
I0830 22:19:04.256118 995192 machine.go:88] provisioning docker machine ...
I0830 22:19:04.256143 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .DriverName
I0830 22:19:04.256344 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetMachineName
I0830 22:19:04.256504 995192 buildroot.go:166] provisioning hostname "default-k8s-diff-port-791007"
I0830 22:19:04.256525 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetMachineName
I0830 22:19:04.256653 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHHostname
I0830 22:19:04.259010 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.259366 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:04.259389 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.259509 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHPort
I0830 22:19:04.259667 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHKeyPath
I0830 22:19:04.259835 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHKeyPath
I0830 22:19:04.259943 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHUsername
I0830 22:19:04.260115 995192 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:04.260787 995192 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.61.104 22 <nil> <nil>}
I0830 22:19:04.260810 995192 main.go:141] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-791007 && echo "default-k8s-diff-port-791007" | sudo tee /etc/hostname
I0830 22:19:04.403123 995192 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-791007
I0830 22:19:04.403166 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHHostname
I0830 22:19:04.405835 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.406219 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:04.406270 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.406476 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHPort
I0830 22:19:04.406704 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHKeyPath
I0830 22:19:04.406892 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHKeyPath
I0830 22:19:04.407047 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHUsername
I0830 22:19:04.407233 995192 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:04.407634 995192 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.61.104 22 <nil> <nil>}
I0830 22:19:04.407658 995192 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-791007' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-791007/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-791007' | sudo tee -a /etc/hosts;
fi
fi
I0830 22:19:04.549964 995192 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0830 22:19:04.550002 995192 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17114-955377/.minikube CaCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17114-955377/.minikube}
I0830 22:19:04.550039 995192 buildroot.go:174] setting up certificates
I0830 22:19:04.550053 995192 provision.go:83] configureAuth start
I0830 22:19:04.550071 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetMachineName
I0830 22:19:04.550422 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetIP
I0830 22:19:04.552844 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.553116 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:04.553150 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.553313 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHHostname
I0830 22:19:04.555514 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.555880 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:04.555917 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.556036 995192 provision.go:138] copyHostCerts
I0830 22:19:04.556100 995192 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem, removing ...
I0830 22:19:04.556133 995192 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem
I0830 22:19:04.556213 995192 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem (1679 bytes)
I0830 22:19:04.556343 995192 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem, removing ...
I0830 22:19:04.556354 995192 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem
I0830 22:19:04.556392 995192 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem (1078 bytes)
I0830 22:19:04.556485 995192 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem, removing ...
I0830 22:19:04.556496 995192 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem
I0830 22:19:04.556528 995192 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem (1123 bytes)
I0830 22:19:04.556607 995192 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-791007 san=[192.168.61.104 192.168.61.104 localhost 127.0.0.1 minikube default-k8s-diff-port-791007]
I0830 22:19:04.756354 995192 provision.go:172] copyRemoteCerts
I0830 22:19:04.756413 995192 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0830 22:19:04.756438 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHHostname
I0830 22:19:04.759134 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.759511 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:04.759544 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.759739 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHPort
I0830 22:19:04.759977 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHKeyPath
I0830 22:19:04.760153 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHUsername
I0830 22:19:04.760297 995192 sshutil.go:53] new ssh client: &{IP:192.168.61.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/default-k8s-diff-port-791007/id_rsa Username:docker}
I0830 22:19:04.858949 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0830 22:19:04.882455 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem --> /etc/docker/server.pem (1257 bytes)
I0830 22:19:04.905659 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0830 22:19:04.929876 995192 provision.go:86] duration metric: configureAuth took 379.794026ms
I0830 22:19:04.929905 995192 buildroot.go:189] setting minikube options for container-runtime
I0830 22:19:04.930124 995192 config.go:182] Loaded profile config "default-k8s-diff-port-791007": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.1
I0830 22:19:04.930228 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHHostname
I0830 22:19:04.932799 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.933159 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:04.933192 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:04.933316 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHPort
I0830 22:19:04.933531 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHKeyPath
I0830 22:19:04.933703 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHKeyPath
I0830 22:19:04.933835 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHUsername
I0830 22:19:04.934015 995192 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:04.934606 995192 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.61.104 22 <nil> <nil>}
I0830 22:19:04.934633 995192 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0830 22:19:05.266317 995192 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0830 22:19:05.266349 995192 machine.go:91] provisioned docker machine in 1.010213866s
I0830 22:19:05.266363 995192 start.go:300] post-start starting for "default-k8s-diff-port-791007" (driver="kvm2")
I0830 22:19:05.266378 995192 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0830 22:19:05.266402 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .DriverName
I0830 22:19:05.266764 995192 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0830 22:19:05.266802 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHHostname
I0830 22:19:05.269938 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:05.270300 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:05.270345 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:05.270472 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHPort
I0830 22:19:05.270650 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHKeyPath
I0830 22:19:05.270800 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHUsername
I0830 22:19:05.270922 995192 sshutil.go:53] new ssh client: &{IP:192.168.61.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/default-k8s-diff-port-791007/id_rsa Username:docker}
I0830 22:19:05.365334 995192 ssh_runner.go:195] Run: cat /etc/os-release
I0830 22:19:05.369583 995192 info.go:137] Remote host: Buildroot 2021.02.12
I0830 22:19:05.369608 995192 filesync.go:126] Scanning /home/jenkins/minikube-integration/17114-955377/.minikube/addons for local assets ...
I0830 22:19:05.369701 995192 filesync.go:126] Scanning /home/jenkins/minikube-integration/17114-955377/.minikube/files for local assets ...
I0830 22:19:05.369790 995192 filesync.go:149] local asset: /home/jenkins/minikube-integration/17114-955377/.minikube/files/etc/ssl/certs/9626212.pem -> 9626212.pem in /etc/ssl/certs
I0830 22:19:05.369879 995192 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0830 22:19:05.377933 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/files/etc/ssl/certs/9626212.pem --> /etc/ssl/certs/9626212.pem (1708 bytes)
I0830 22:19:05.401027 995192 start.go:303] post-start completed in 134.648062ms
I0830 22:19:05.401051 995192 fix.go:56] fixHost completed within 20.37520461s
I0830 22:19:05.401079 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHHostname
I0830 22:19:05.404156 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:05.404595 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:05.404629 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:05.404765 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHPort
I0830 22:19:05.404960 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHKeyPath
I0830 22:19:05.405138 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHKeyPath
I0830 22:19:05.405260 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHUsername
I0830 22:19:05.405463 995192 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:05.405917 995192 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.61.104 22 <nil> <nil>}
I0830 22:19:05.405930 995192 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0830 22:19:05.536449 995192 main.go:141] libmachine: SSH cmd err, output: <nil>: 1693433945.485000324
I0830 22:19:05.536479 995192 fix.go:206] guest clock: 1693433945.485000324
I0830 22:19:05.536490 995192 fix.go:219] Guest: 2023-08-30 22:19:05.485000324 +0000 UTC Remote: 2023-08-30 22:19:05.401056033 +0000 UTC m=+233.468479321 (delta=83.944291ms)
I0830 22:19:05.536524 995192 fix.go:190] guest clock delta is within tolerance: 83.944291ms
I0830 22:19:05.536535 995192 start.go:83] releasing machines lock for "default-k8s-diff-port-791007", held for 20.510742441s
I0830 22:19:05.536569 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .DriverName
I0830 22:19:05.536868 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetIP
I0830 22:19:05.539651 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:05.540017 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:05.540057 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:05.540196 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .DriverName
I0830 22:19:05.540737 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .DriverName
I0830 22:19:05.540911 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .DriverName
I0830 22:19:05.540975 995192 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0830 22:19:05.541036 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHHostname
I0830 22:19:05.541133 995192 ssh_runner.go:195] Run: cat /version.json
I0830 22:19:05.541172 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHHostname
I0830 22:19:05.543846 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:05.543892 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:05.544250 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:05.544286 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:05.544317 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:05.544338 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:05.544411 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHPort
I0830 22:19:05.544540 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHPort
I0830 22:19:05.544627 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHKeyPath
I0830 22:19:05.544707 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHKeyPath
I0830 22:19:05.544792 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHUsername
I0830 22:19:05.544865 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetSSHUsername
I0830 22:19:05.544926 995192 sshutil.go:53] new ssh client: &{IP:192.168.61.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/default-k8s-diff-port-791007/id_rsa Username:docker}
I0830 22:19:05.544972 995192 sshutil.go:53] new ssh client: &{IP:192.168.61.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/default-k8s-diff-port-791007/id_rsa Username:docker}
I0830 22:19:05.677442 995192 ssh_runner.go:195] Run: systemctl --version
I0830 22:19:05.683243 995192 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0830 22:19:05.832776 995192 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0830 22:19:05.838924 995192 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0830 22:19:05.839000 995192 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0830 22:19:05.857231 995192 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0830 22:19:05.857251 995192 start.go:466] detecting cgroup driver to use...
I0830 22:19:05.857349 995192 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0830 22:19:05.875107 995192 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0830 22:19:05.888540 995192 docker.go:196] disabling cri-docker service (if available) ...
I0830 22:19:05.888603 995192 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0830 22:19:05.901129 995192 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0830 22:19:05.914011 995192 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0830 22:19:06.015763 995192 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0830 22:19:06.144950 995192 docker.go:212] disabling docker service ...
I0830 22:19:06.145052 995192 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0830 22:19:06.159373 995192 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0830 22:19:06.172560 995192 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0830 22:19:06.279514 995192 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0830 22:19:06.413719 995192 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0830 22:19:06.427047 995192 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0830 22:19:06.443765 995192 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0830 22:19:06.443853 995192 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0830 22:19:06.452621 995192 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0830 22:19:06.452690 995192 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0830 22:19:06.461365 995192 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0830 22:19:06.470052 995192 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0830 22:19:06.478685 995192 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0830 22:19:06.487763 995192 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0830 22:19:06.495483 995192 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0830 22:19:06.495551 995192 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0830 22:19:06.508009 995192 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0830 22:19:06.516397 995192 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0830 22:19:06.615209 995192 ssh_runner.go:195] Run: sudo systemctl restart crio
I0830 22:19:06.792388 995192 start.go:513] Will wait 60s for socket path /var/run/crio/crio.sock
I0830 22:19:06.792466 995192 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0830 22:19:06.798170 995192 start.go:534] Will wait 60s for crictl version
I0830 22:19:06.798231 995192 ssh_runner.go:195] Run: which crictl
I0830 22:19:06.801828 995192 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0830 22:19:06.842351 995192 start.go:550] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1alpha2
I0830 22:19:06.842459 995192 ssh_runner.go:195] Run: crio --version
I0830 22:19:06.898609 995192 ssh_runner.go:195] Run: crio --version
I0830 22:19:06.962179 995192 out.go:177] * Preparing Kubernetes v1.28.1 on CRI-O 1.24.1 ...
I0830 22:19:06.963711 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) Calling .GetIP
I0830 22:19:06.966803 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:06.967189 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:2e:1e", ip: ""} in network mk-default-k8s-diff-port-791007: {Iface:virbr3 ExpiryTime:2023-08-30 23:18:57 +0000 UTC Type:0 Mac:52:54:00:1e:2e:1e Iaid: IPaddr:192.168.61.104 Prefix:24 Hostname:default-k8s-diff-port-791007 Clientid:01:52:54:00:1e:2e:1e}
I0830 22:19:06.967225 995192 main.go:141] libmachine: (default-k8s-diff-port-791007) DBG | domain default-k8s-diff-port-791007 has defined IP address 192.168.61.104 and MAC address 52:54:00:1e:2e:1e in network mk-default-k8s-diff-port-791007
I0830 22:19:06.967412 995192 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0830 22:19:06.972033 995192 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0830 22:19:05.564313 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .Start
I0830 22:19:05.564511 995603 main.go:141] libmachine: (old-k8s-version-250163) Ensuring networks are active...
I0830 22:19:05.565235 995603 main.go:141] libmachine: (old-k8s-version-250163) Ensuring network default is active
I0830 22:19:05.565567 995603 main.go:141] libmachine: (old-k8s-version-250163) Ensuring network mk-old-k8s-version-250163 is active
I0830 22:19:05.565954 995603 main.go:141] libmachine: (old-k8s-version-250163) Getting domain xml...
I0830 22:19:05.566644 995603 main.go:141] libmachine: (old-k8s-version-250163) Creating domain...
I0830 22:19:06.869485 995603 main.go:141] libmachine: (old-k8s-version-250163) Waiting to get IP...
I0830 22:19:06.870595 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:06.871071 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | unable to find current IP address of domain old-k8s-version-250163 in network mk-old-k8s-version-250163
I0830 22:19:06.871133 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | I0830 22:19:06.871046 996542 retry.go:31] will retry after 294.811471ms: waiting for machine to come up
I0830 22:19:07.167657 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:07.168126 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | unable to find current IP address of domain old-k8s-version-250163 in network mk-old-k8s-version-250163
I0830 22:19:07.168172 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | I0830 22:19:07.168099 996542 retry.go:31] will retry after 376.474639ms: waiting for machine to come up
I0830 22:19:07.546876 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:07.547389 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | unable to find current IP address of domain old-k8s-version-250163 in network mk-old-k8s-version-250163
I0830 22:19:07.547419 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | I0830 22:19:07.547354 996542 retry.go:31] will retry after 329.757182ms: waiting for machine to come up
I0830 22:19:07.878995 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:07.879572 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | unable to find current IP address of domain old-k8s-version-250163 in network mk-old-k8s-version-250163
I0830 22:19:07.879601 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | I0830 22:19:07.879529 996542 retry.go:31] will retry after 567.335814ms: waiting for machine to come up
I0830 22:19:08.448373 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:08.448996 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | unable to find current IP address of domain old-k8s-version-250163 in network mk-old-k8s-version-250163
I0830 22:19:08.449028 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | I0830 22:19:08.448958 996542 retry.go:31] will retry after 510.216093ms: waiting for machine to come up
I0830 22:19:08.960855 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:08.961412 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | unable to find current IP address of domain old-k8s-version-250163 in network mk-old-k8s-version-250163
I0830 22:19:08.961451 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | I0830 22:19:08.961326 996542 retry.go:31] will retry after 688.575912ms: waiting for machine to come up
I0830 22:19:09.651966 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:09.652379 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | unable to find current IP address of domain old-k8s-version-250163 in network mk-old-k8s-version-250163
I0830 22:19:09.652411 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | I0830 22:19:09.652346 996542 retry.go:31] will retry after 1.130912238s: waiting for machine to come up
I0830 22:19:06.984632 995192 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime crio
I0830 22:19:06.984698 995192 ssh_runner.go:195] Run: sudo crictl images --output json
I0830 22:19:07.020200 995192 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.1". assuming images are not preloaded.
I0830 22:19:07.020282 995192 ssh_runner.go:195] Run: which lz4
I0830 22:19:07.024254 995192 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0830 22:19:07.028470 995192 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0830 22:19:07.028508 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (457053495 bytes)
I0830 22:19:08.986852 995192 crio.go:444] Took 1.962647 seconds to copy over tarball
I0830 22:19:08.986915 995192 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
I0830 22:19:10.784839 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:10.785424 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | unable to find current IP address of domain old-k8s-version-250163 in network mk-old-k8s-version-250163
I0830 22:19:10.785456 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | I0830 22:19:10.785355 996542 retry.go:31] will retry after 898.98114ms: waiting for machine to come up
I0830 22:19:11.685890 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:11.686614 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | unable to find current IP address of domain old-k8s-version-250163 in network mk-old-k8s-version-250163
I0830 22:19:11.686646 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | I0830 22:19:11.686558 996542 retry.go:31] will retry after 1.621086004s: waiting for machine to come up
I0830 22:19:13.310234 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:13.310696 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | unable to find current IP address of domain old-k8s-version-250163 in network mk-old-k8s-version-250163
I0830 22:19:13.310721 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | I0830 22:19:13.310630 996542 retry.go:31] will retry after 1.652651656s: waiting for machine to come up
I0830 22:19:12.113071 995192 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (3.126115747s)
I0830 22:19:12.113107 995192 crio.go:451] Took 3.126230 seconds to extract the tarball
I0830 22:19:12.113120 995192 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0830 22:19:12.156320 995192 ssh_runner.go:195] Run: sudo crictl images --output json
I0830 22:19:12.200547 995192 crio.go:496] all images are preloaded for cri-o runtime.
I0830 22:19:12.200573 995192 cache_images.go:84] Images are preloaded, skipping loading
I0830 22:19:12.200652 995192 ssh_runner.go:195] Run: crio config
I0830 22:19:12.273153 995192 cni.go:84] Creating CNI manager for ""
I0830 22:19:12.273180 995192 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0830 22:19:12.273205 995192 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0830 22:19:12.273231 995192 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.104 APIServerPort:8444 KubernetesVersion:v1.28.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-791007 NodeName:default-k8s-diff-port-791007 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.104"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.104 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/cer
ts/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0830 22:19:12.273413 995192 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.104
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "default-k8s-diff-port-791007"
kubeletExtraArgs:
node-ip: 192.168.61.104
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.104"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0830 22:19:12.273497 995192 kubeadm.go:976] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=default-k8s-diff-port-791007 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.61.104
[Install]
config:
{KubernetesVersion:v1.28.1 ClusterName:default-k8s-diff-port-791007 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:}
I0830 22:19:12.273573 995192 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.1
I0830 22:19:12.283536 995192 binaries.go:44] Found k8s binaries, skipping transfer
I0830 22:19:12.283609 995192 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0830 22:19:12.292260 995192 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (388 bytes)
I0830 22:19:12.309407 995192 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0830 22:19:12.325757 995192 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2115 bytes)
I0830 22:19:12.342664 995192 ssh_runner.go:195] Run: grep 192.168.61.104 control-plane.minikube.internal$ /etc/hosts
I0830 22:19:12.346459 995192 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.104 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0830 22:19:12.358721 995192 certs.go:56] Setting up /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/default-k8s-diff-port-791007 for IP: 192.168.61.104
I0830 22:19:12.358797 995192 certs.go:190] acquiring lock for shared ca certs: {Name:mk2e67e13d79d15c3d002a96b2a7f288fae16325 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0830 22:19:12.359010 995192 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/17114-955377/.minikube/ca.key
I0830 22:19:12.359066 995192 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/17114-955377/.minikube/proxy-client-ca.key
I0830 22:19:12.359147 995192 certs.go:315] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/default-k8s-diff-port-791007/client.key
I0830 22:19:12.359219 995192 certs.go:315] skipping minikube signed cert generation: /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/default-k8s-diff-port-791007/apiserver.key.a202b4d9
I0830 22:19:12.359255 995192 certs.go:315] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/default-k8s-diff-port-791007/proxy-client.key
I0830 22:19:12.359363 995192 certs.go:437] found cert: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/home/jenkins/minikube-integration/17114-955377/.minikube/certs/962621.pem (1338 bytes)
W0830 22:19:12.359390 995192 certs.go:433] ignoring /home/jenkins/minikube-integration/17114-955377/.minikube/certs/home/jenkins/minikube-integration/17114-955377/.minikube/certs/962621_empty.pem, impossibly tiny 0 bytes
I0830 22:19:12.359400 995192 certs.go:437] found cert: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem (1679 bytes)
I0830 22:19:12.359424 995192 certs.go:437] found cert: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem (1078 bytes)
I0830 22:19:12.359449 995192 certs.go:437] found cert: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem (1123 bytes)
I0830 22:19:12.359471 995192 certs.go:437] found cert: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem (1679 bytes)
I0830 22:19:12.359507 995192 certs.go:437] found cert: /home/jenkins/minikube-integration/17114-955377/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/17114-955377/.minikube/files/etc/ssl/certs/9626212.pem (1708 bytes)
I0830 22:19:12.360328 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/default-k8s-diff-port-791007/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0830 22:19:12.385275 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/default-k8s-diff-port-791007/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0830 22:19:12.410697 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/default-k8s-diff-port-791007/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0830 22:19:12.434240 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/default-k8s-diff-port-791007/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0830 22:19:12.457206 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0830 22:19:12.484695 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0830 22:19:12.507670 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0830 22:19:12.531114 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0830 22:19:12.554501 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/certs/962621.pem --> /usr/share/ca-certificates/962621.pem (1338 bytes)
I0830 22:19:12.579425 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/files/etc/ssl/certs/9626212.pem --> /usr/share/ca-certificates/9626212.pem (1708 bytes)
I0830 22:19:12.603211 995192 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0830 22:19:12.628506 995192 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0830 22:19:12.645536 995192 ssh_runner.go:195] Run: openssl version
I0830 22:19:12.650882 995192 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/962621.pem && ln -fs /usr/share/ca-certificates/962621.pem /etc/ssl/certs/962621.pem"
I0830 22:19:12.660449 995192 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/962621.pem
I0830 22:19:12.665173 995192 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Aug 30 21:18 /usr/share/ca-certificates/962621.pem
I0830 22:19:12.665239 995192 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/962621.pem
I0830 22:19:12.670785 995192 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/962621.pem /etc/ssl/certs/51391683.0"
I0830 22:19:12.681196 995192 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9626212.pem && ln -fs /usr/share/ca-certificates/9626212.pem /etc/ssl/certs/9626212.pem"
I0830 22:19:12.690775 995192 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9626212.pem
I0830 22:19:12.695204 995192 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Aug 30 21:18 /usr/share/ca-certificates/9626212.pem
I0830 22:19:12.695262 995192 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9626212.pem
I0830 22:19:12.700668 995192 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/9626212.pem /etc/ssl/certs/3ec20f2e.0"
I0830 22:19:12.710205 995192 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0830 22:19:12.719691 995192 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0830 22:19:12.724744 995192 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Aug 30 21:10 /usr/share/ca-certificates/minikubeCA.pem
I0830 22:19:12.724803 995192 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0830 22:19:12.730472 995192 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0830 22:19:12.740194 995192 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I0830 22:19:12.744773 995192 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0830 22:19:12.750633 995192 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0830 22:19:12.756228 995192 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0830 22:19:12.762258 995192 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0830 22:19:12.767895 995192 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0830 22:19:12.773716 995192 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0830 22:19:12.779716 995192 kubeadm.go:404] StartCluster: {Name:default-k8s-diff-port-791007 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17120/minikube-v1.31.0-1692872107-17120-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1692872184-17120@sha256:42602f0d347faca66d9347bdc33243fe5f4d6b3fff3ba53f3b2fc2d5fe63e9ec Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.1 ClusterName:default-k8s-diff-port-791007 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.61.104 Port:8444 KubernetesVersion:v1.28.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false Extr
aDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
I0830 22:19:12.779849 995192 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0830 22:19:12.779895 995192 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0830 22:19:12.808983 995192 cri.go:89] found id: ""
I0830 22:19:12.809055 995192 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0830 22:19:12.818188 995192 kubeadm.go:419] found existing configuration files, will attempt cluster restart
I0830 22:19:12.818208 995192 kubeadm.go:636] restartCluster start
I0830 22:19:12.818258 995192 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0830 22:19:12.829333 995192 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0830 22:19:12.830440 995192 kubeconfig.go:92] found "default-k8s-diff-port-791007" server: "https://192.168.61.104:8444"
I0830 22:19:12.833172 995192 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0830 22:19:12.841419 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:12.841468 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:12.852072 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:12.852092 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:12.852135 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:12.862195 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:13.362894 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:13.362981 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:13.374932 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:13.862450 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:13.862558 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:13.874629 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:14.363249 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:14.363368 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:14.375071 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:14.862656 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:14.862767 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:14.874077 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:15.363282 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:15.363389 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:15.374762 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:15.862279 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:15.862375 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:15.873942 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:16.362457 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:16.362554 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:16.373922 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:16.862336 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:16.862415 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:16.873540 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:14.964585 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:14.965020 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | unable to find current IP address of domain old-k8s-version-250163 in network mk-old-k8s-version-250163
I0830 22:19:14.965042 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | I0830 22:19:14.964995 996542 retry.go:31] will retry after 1.89297354s: waiting for machine to come up
I0830 22:19:16.859309 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:16.859825 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | unable to find current IP address of domain old-k8s-version-250163 in network mk-old-k8s-version-250163
I0830 22:19:16.859852 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | I0830 22:19:16.859777 996542 retry.go:31] will retry after 2.908196896s: waiting for machine to come up
I0830 22:19:17.363243 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:17.363347 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:17.378177 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:17.862706 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:17.862785 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:17.877394 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:18.363052 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:18.363183 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:18.377397 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:18.862918 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:18.862995 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:18.878397 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:19.362972 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:19.363052 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:19.374591 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:19.863153 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:19.863233 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:19.878572 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:20.362613 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:20.362703 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:20.374006 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:20.862535 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:20.862634 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:20.874066 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:21.362612 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:21.362721 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:21.375262 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:21.863011 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:21.863113 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:21.874498 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:19.771969 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:19.772453 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | unable to find current IP address of domain old-k8s-version-250163 in network mk-old-k8s-version-250163
I0830 22:19:19.772482 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | I0830 22:19:19.772410 996542 retry.go:31] will retry after 3.967899631s: waiting for machine to come up
I0830 22:19:23.743741 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:23.744344 995603 main.go:141] libmachine: (old-k8s-version-250163) Found IP for machine: 192.168.39.10
I0830 22:19:23.744371 995603 main.go:141] libmachine: (old-k8s-version-250163) Reserving static IP address...
I0830 22:19:23.744387 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has current primary IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:23.744827 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "old-k8s-version-250163", mac: "52:54:00:ba:25:c9", ip: "192.168.39.10"} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:23.744860 995603 main.go:141] libmachine: (old-k8s-version-250163) Reserved static IP address: 192.168.39.10
I0830 22:19:23.744877 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | skip adding static IP to network mk-old-k8s-version-250163 - found existing host DHCP lease matching {name: "old-k8s-version-250163", mac: "52:54:00:ba:25:c9", ip: "192.168.39.10"}
I0830 22:19:23.744904 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | Getting to WaitForSSH function...
I0830 22:19:23.744920 995603 main.go:141] libmachine: (old-k8s-version-250163) Waiting for SSH to be available...
I0830 22:19:23.747285 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:23.747642 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:23.747676 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:23.747864 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | Using SSH client type: external
I0830 22:19:23.747896 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | Using SSH private key: /home/jenkins/minikube-integration/17114-955377/.minikube/machines/old-k8s-version-250163/id_rsa (-rw-------)
I0830 22:19:23.747935 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.10 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17114-955377/.minikube/machines/old-k8s-version-250163/id_rsa -p 22] /usr/bin/ssh <nil>}
I0830 22:19:23.747954 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | About to run SSH command:
I0830 22:19:23.747971 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | exit 0
I0830 22:19:23.836434 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | SSH cmd err, output: <nil>:
I0830 22:19:23.837035 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetConfigRaw
I0830 22:19:23.837845 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetIP
I0830 22:19:23.840648 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:23.841059 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:23.841088 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:23.841433 995603 profile.go:148] Saving config to /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/old-k8s-version-250163/config.json ...
I0830 22:19:23.841663 995603 machine.go:88] provisioning docker machine ...
I0830 22:19:23.841688 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .DriverName
I0830 22:19:23.841895 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetMachineName
I0830 22:19:23.842049 995603 buildroot.go:166] provisioning hostname "old-k8s-version-250163"
I0830 22:19:23.842069 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetMachineName
I0830 22:19:23.842291 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHHostname
I0830 22:19:23.844953 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:23.845376 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:23.845408 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:23.845678 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHPort
I0830 22:19:23.845885 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHKeyPath
I0830 22:19:23.846036 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHKeyPath
I0830 22:19:23.846186 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHUsername
I0830 22:19:23.846361 995603 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:23.846839 995603 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.39.10 22 <nil> <nil>}
I0830 22:19:23.846861 995603 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-250163 && echo "old-k8s-version-250163" | sudo tee /etc/hostname
I0830 22:19:23.981507 995603 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-250163
I0830 22:19:23.981556 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHHostname
I0830 22:19:23.984891 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:23.985199 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:23.985249 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:23.985369 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHPort
I0830 22:19:23.985604 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHKeyPath
I0830 22:19:23.985811 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHKeyPath
I0830 22:19:23.986000 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHUsername
I0830 22:19:23.986199 995603 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:23.986603 995603 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.39.10 22 <nil> <nil>}
I0830 22:19:23.986620 995603 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-250163' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-250163/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-250163' | sudo tee -a /etc/hosts;
fi
fi
I0830 22:19:24.115894 995603 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0830 22:19:24.115952 995603 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17114-955377/.minikube CaCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17114-955377/.minikube}
I0830 22:19:24.115985 995603 buildroot.go:174] setting up certificates
I0830 22:19:24.115996 995603 provision.go:83] configureAuth start
I0830 22:19:24.116014 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetMachineName
I0830 22:19:24.116342 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetIP
I0830 22:19:24.118887 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:24.119266 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:24.119312 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:24.119572 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHHostname
I0830 22:19:24.122166 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:24.122551 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:24.122590 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:24.122700 995603 provision.go:138] copyHostCerts
I0830 22:19:24.122769 995603 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem, removing ...
I0830 22:19:24.122793 995603 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem
I0830 22:19:24.122868 995603 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem (1078 bytes)
I0830 22:19:24.122989 995603 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem, removing ...
I0830 22:19:24.123004 995603 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem
I0830 22:19:24.123035 995603 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem (1123 bytes)
I0830 22:19:24.123168 995603 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem, removing ...
I0830 22:19:24.123184 995603 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem
I0830 22:19:24.123217 995603 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem (1679 bytes)
I0830 22:19:24.123302 995603 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-250163 san=[192.168.39.10 192.168.39.10 localhost 127.0.0.1 minikube old-k8s-version-250163]
I0830 22:19:24.303093 995603 provision.go:172] copyRemoteCerts
I0830 22:19:24.303156 995603 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0830 22:19:24.303182 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHHostname
I0830 22:19:24.305900 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:24.306173 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:24.306199 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:24.306352 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHPort
I0830 22:19:24.306545 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHKeyPath
I0830 22:19:24.306728 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHUsername
I0830 22:19:24.306873 995603 sshutil.go:53] new ssh client: &{IP:192.168.39.10 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/old-k8s-version-250163/id_rsa Username:docker}
I0830 22:19:24.393858 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0830 22:19:24.418791 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I0830 22:19:24.441090 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0830 22:19:24.462926 995603 provision.go:86] duration metric: configureAuth took 346.913079ms
I0830 22:19:24.462952 995603 buildroot.go:189] setting minikube options for container-runtime
I0830 22:19:24.463136 995603 config.go:182] Loaded profile config "old-k8s-version-250163": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0830 22:19:24.463224 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHHostname
I0830 22:19:24.465978 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:24.466321 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:24.466357 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:24.466559 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHPort
I0830 22:19:24.466785 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHKeyPath
I0830 22:19:24.466934 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHKeyPath
I0830 22:19:24.467035 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHUsername
I0830 22:19:24.467173 995603 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:24.467657 995603 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.39.10 22 <nil> <nil>}
I0830 22:19:24.467676 995603 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0830 22:19:25.058077 994624 start.go:369] acquired machines lock for "no-preload-698195" in 53.768050843s
I0830 22:19:25.058128 994624 start.go:96] Skipping create...Using existing machine configuration
I0830 22:19:25.058141 994624 fix.go:54] fixHost starting:
I0830 22:19:25.058564 994624 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0830 22:19:25.058603 994624 main.go:141] libmachine: Launching plugin server for driver kvm2
I0830 22:19:25.076580 994624 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45105
I0830 22:19:25.077082 994624 main.go:141] libmachine: () Calling .GetVersion
I0830 22:19:25.077788 994624 main.go:141] libmachine: Using API Version 1
I0830 22:19:25.077824 994624 main.go:141] libmachine: () Calling .SetConfigRaw
I0830 22:19:25.078214 994624 main.go:141] libmachine: () Calling .GetMachineName
I0830 22:19:25.078418 994624 main.go:141] libmachine: (no-preload-698195) Calling .DriverName
I0830 22:19:25.078695 994624 main.go:141] libmachine: (no-preload-698195) Calling .GetState
I0830 22:19:25.080411 994624 fix.go:102] recreateIfNeeded on no-preload-698195: state=Stopped err=<nil>
I0830 22:19:25.080447 994624 main.go:141] libmachine: (no-preload-698195) Calling .DriverName
W0830 22:19:25.080636 994624 fix.go:128] unexpected machine state, will restart: <nil>
I0830 22:19:25.082566 994624 out.go:177] * Restarting existing kvm2 VM for "no-preload-698195" ...
I0830 22:19:24.795523 995603 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0830 22:19:24.795562 995603 machine.go:91] provisioned docker machine in 953.87669ms
I0830 22:19:24.795575 995603 start.go:300] post-start starting for "old-k8s-version-250163" (driver="kvm2")
I0830 22:19:24.795590 995603 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0830 22:19:24.795616 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .DriverName
I0830 22:19:24.795984 995603 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0830 22:19:24.796046 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHHostname
I0830 22:19:24.799136 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:24.799534 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:24.799561 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:24.799797 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHPort
I0830 22:19:24.799996 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHKeyPath
I0830 22:19:24.800210 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHUsername
I0830 22:19:24.800396 995603 sshutil.go:53] new ssh client: &{IP:192.168.39.10 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/old-k8s-version-250163/id_rsa Username:docker}
I0830 22:19:24.890335 995603 ssh_runner.go:195] Run: cat /etc/os-release
I0830 22:19:24.894780 995603 info.go:137] Remote host: Buildroot 2021.02.12
I0830 22:19:24.894807 995603 filesync.go:126] Scanning /home/jenkins/minikube-integration/17114-955377/.minikube/addons for local assets ...
I0830 22:19:24.894890 995603 filesync.go:126] Scanning /home/jenkins/minikube-integration/17114-955377/.minikube/files for local assets ...
I0830 22:19:24.894986 995603 filesync.go:149] local asset: /home/jenkins/minikube-integration/17114-955377/.minikube/files/etc/ssl/certs/9626212.pem -> 9626212.pem in /etc/ssl/certs
I0830 22:19:24.895110 995603 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0830 22:19:24.907259 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/files/etc/ssl/certs/9626212.pem --> /etc/ssl/certs/9626212.pem (1708 bytes)
I0830 22:19:24.932802 995603 start.go:303] post-start completed in 137.211475ms
I0830 22:19:24.932829 995603 fix.go:56] fixHost completed within 19.396077949s
I0830 22:19:24.932858 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHHostname
I0830 22:19:24.935762 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:24.936118 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:24.936160 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:24.936310 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHPort
I0830 22:19:24.936538 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHKeyPath
I0830 22:19:24.936721 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHKeyPath
I0830 22:19:24.936918 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHUsername
I0830 22:19:24.937109 995603 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:24.937748 995603 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.39.10 22 <nil> <nil>}
I0830 22:19:24.937767 995603 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0830 22:19:25.057876 995603 main.go:141] libmachine: SSH cmd err, output: <nil>: 1693433965.004650095
I0830 22:19:25.057911 995603 fix.go:206] guest clock: 1693433965.004650095
I0830 22:19:25.057924 995603 fix.go:219] Guest: 2023-08-30 22:19:25.004650095 +0000 UTC Remote: 2023-08-30 22:19:24.932833395 +0000 UTC m=+145.224486267 (delta=71.8167ms)
I0830 22:19:25.057987 995603 fix.go:190] guest clock delta is within tolerance: 71.8167ms
I0830 22:19:25.057998 995603 start.go:83] releasing machines lock for "old-k8s-version-250163", held for 19.521294969s
I0830 22:19:25.058036 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .DriverName
I0830 22:19:25.058351 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetIP
I0830 22:19:25.061325 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:25.061749 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:25.061782 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:25.061965 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .DriverName
I0830 22:19:25.062635 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .DriverName
I0830 22:19:25.062829 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .DriverName
I0830 22:19:25.062921 995603 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0830 22:19:25.062977 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHHostname
I0830 22:19:25.063084 995603 ssh_runner.go:195] Run: cat /version.json
I0830 22:19:25.063119 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHHostname
I0830 22:19:25.065978 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:25.066217 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:25.066375 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:25.066428 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:25.066620 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHPort
I0830 22:19:25.066668 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:25.066784 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHPort
I0830 22:19:25.066806 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:25.066829 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHKeyPath
I0830 22:19:25.066953 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHKeyPath
I0830 22:19:25.067142 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHUsername
I0830 22:19:25.067206 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetSSHUsername
I0830 22:19:25.067278 995603 sshutil.go:53] new ssh client: &{IP:192.168.39.10 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/old-k8s-version-250163/id_rsa Username:docker}
I0830 22:19:25.067389 995603 sshutil.go:53] new ssh client: &{IP:192.168.39.10 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/old-k8s-version-250163/id_rsa Username:docker}
I0830 22:19:25.181017 995603 ssh_runner.go:195] Run: systemctl --version
I0830 22:19:25.188428 995603 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0830 22:19:25.337310 995603 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0830 22:19:25.346144 995603 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0830 22:19:25.346231 995603 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0830 22:19:25.368931 995603 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0830 22:19:25.368966 995603 start.go:466] detecting cgroup driver to use...
I0830 22:19:25.369048 995603 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0830 22:19:25.383524 995603 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0830 22:19:25.399296 995603 docker.go:196] disabling cri-docker service (if available) ...
I0830 22:19:25.399365 995603 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0830 22:19:25.416387 995603 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0830 22:19:25.430426 995603 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0830 22:19:25.552861 995603 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0830 22:19:25.699278 995603 docker.go:212] disabling docker service ...
I0830 22:19:25.699350 995603 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0830 22:19:25.718108 995603 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0830 22:19:25.736420 995603 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0830 22:19:25.871165 995603 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0830 22:19:25.993674 995603 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0830 22:19:26.009215 995603 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0830 22:19:26.027014 995603 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.1" pause image...
I0830 22:19:26.027122 995603 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I0830 22:19:26.038902 995603 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0830 22:19:26.038985 995603 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0830 22:19:26.051908 995603 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0830 22:19:26.062635 995603 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0830 22:19:26.073049 995603 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0830 22:19:26.086514 995603 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0830 22:19:26.098352 995603 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0830 22:19:26.098405 995603 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0830 22:19:26.117326 995603 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0830 22:19:26.129854 995603 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0830 22:19:26.259656 995603 ssh_runner.go:195] Run: sudo systemctl restart crio
I0830 22:19:26.476938 995603 start.go:513] Will wait 60s for socket path /var/run/crio/crio.sock
I0830 22:19:26.477034 995603 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0830 22:19:26.482773 995603 start.go:534] Will wait 60s for crictl version
I0830 22:19:26.482841 995603 ssh_runner.go:195] Run: which crictl
I0830 22:19:26.486853 995603 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0830 22:19:26.525498 995603 start.go:550] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1alpha2
I0830 22:19:26.525595 995603 ssh_runner.go:195] Run: crio --version
I0830 22:19:26.585226 995603 ssh_runner.go:195] Run: crio --version
I0830 22:19:26.641386 995603 out.go:177] * Preparing Kubernetes v1.16.0 on CRI-O 1.24.1 ...
I0830 22:19:22.362364 995192 api_server.go:166] Checking apiserver status ...
I0830 22:19:22.362448 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:22.373701 995192 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:22.842449 995192 kubeadm.go:611] needs reconfigure: apiserver error: context deadline exceeded
I0830 22:19:22.842531 995192 kubeadm.go:1128] stopping kube-system containers ...
I0830 22:19:22.842551 995192 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0830 22:19:22.842623 995192 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0830 22:19:22.871557 995192 cri.go:89] found id: ""
I0830 22:19:22.871624 995192 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0830 22:19:22.886295 995192 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0830 22:19:22.894486 995192 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0830 22:19:22.894549 995192 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0830 22:19:22.902556 995192 kubeadm.go:713] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
I0830 22:19:22.902578 995192 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0830 22:19:23.017775 995192 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0830 22:19:23.631493 995192 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0830 22:19:23.831074 995192 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0830 22:19:23.923222 995192 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0830 22:19:23.994499 995192 api_server.go:52] waiting for apiserver process to appear ...
I0830 22:19:23.994583 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0830 22:19:24.007515 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0830 22:19:24.519195 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0830 22:19:25.019167 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0830 22:19:25.519068 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0830 22:19:26.019708 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0830 22:19:26.519664 995192 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0830 22:19:26.547751 995192 api_server.go:72] duration metric: took 2.553248139s to wait for apiserver process to appear ...
I0830 22:19:26.547794 995192 api_server.go:88] waiting for apiserver healthz status ...
I0830 22:19:26.547816 995192 api_server.go:253] Checking apiserver healthz at https://192.168.61.104:8444/healthz ...
I0830 22:19:25.084008 994624 main.go:141] libmachine: (no-preload-698195) Calling .Start
I0830 22:19:25.084189 994624 main.go:141] libmachine: (no-preload-698195) Ensuring networks are active...
I0830 22:19:25.085011 994624 main.go:141] libmachine: (no-preload-698195) Ensuring network default is active
I0830 22:19:25.085319 994624 main.go:141] libmachine: (no-preload-698195) Ensuring network mk-no-preload-698195 is active
I0830 22:19:25.085676 994624 main.go:141] libmachine: (no-preload-698195) Getting domain xml...
I0830 22:19:25.086427 994624 main.go:141] libmachine: (no-preload-698195) Creating domain...
I0830 22:19:26.443042 994624 main.go:141] libmachine: (no-preload-698195) Waiting to get IP...
I0830 22:19:26.444179 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:26.444691 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:26.444784 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:26.444686 996676 retry.go:31] will retry after 208.17912ms: waiting for machine to come up
I0830 22:19:26.654132 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:26.654621 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:26.654651 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:26.654581 996676 retry.go:31] will retry after 304.249592ms: waiting for machine to come up
I0830 22:19:26.960205 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:26.960990 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:26.961014 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:26.960912 996676 retry.go:31] will retry after 342.108913ms: waiting for machine to come up
I0830 22:19:27.304766 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:27.305661 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:27.305700 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:27.305602 996676 retry.go:31] will retry after 500.147687ms: waiting for machine to come up
I0830 22:19:27.808375 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:27.808867 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:27.808884 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:27.808796 996676 retry.go:31] will retry after 562.543443ms: waiting for machine to come up
I0830 22:19:28.373420 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:28.373912 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:28.373938 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:28.373863 996676 retry.go:31] will retry after 755.787662ms: waiting for machine to come up
I0830 22:19:26.642985 995603 main.go:141] libmachine: (old-k8s-version-250163) Calling .GetIP
I0830 22:19:26.646304 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:26.646712 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ba:25:c9", ip: ""} in network mk-old-k8s-version-250163: {Iface:virbr1 ExpiryTime:2023-08-30 23:19:18 +0000 UTC Type:0 Mac:52:54:00:ba:25:c9 Iaid: IPaddr:192.168.39.10 Prefix:24 Hostname:old-k8s-version-250163 Clientid:01:52:54:00:ba:25:c9}
I0830 22:19:26.646773 995603 main.go:141] libmachine: (old-k8s-version-250163) DBG | domain old-k8s-version-250163 has defined IP address 192.168.39.10 and MAC address 52:54:00:ba:25:c9 in network mk-old-k8s-version-250163
I0830 22:19:26.646957 995603 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0830 22:19:26.652439 995603 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0830 22:19:26.667339 995603 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0830 22:19:26.667418 995603 ssh_runner.go:195] Run: sudo crictl images --output json
I0830 22:19:26.703670 995603 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0830 22:19:26.703750 995603 ssh_runner.go:195] Run: which lz4
I0830 22:19:26.708087 995603 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0830 22:19:26.712329 995603 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0830 22:19:26.712362 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (441050307 bytes)
I0830 22:19:28.602303 995603 crio.go:444] Took 1.894253 seconds to copy over tarball
I0830 22:19:28.602408 995603 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
I0830 22:19:30.838763 995192 api_server.go:279] https://192.168.61.104:8444/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0830 22:19:30.838807 995192 api_server.go:103] status: https://192.168.61.104:8444/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0830 22:19:30.838824 995192 api_server.go:253] Checking apiserver healthz at https://192.168.61.104:8444/healthz ...
I0830 22:19:30.908950 995192 api_server.go:279] https://192.168.61.104:8444/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0830 22:19:30.908987 995192 api_server.go:103] status: https://192.168.61.104:8444/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0830 22:19:31.409372 995192 api_server.go:253] Checking apiserver healthz at https://192.168.61.104:8444/healthz ...
I0830 22:19:31.420411 995192 api_server.go:279] https://192.168.61.104:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0830 22:19:31.420480 995192 api_server.go:103] status: https://192.168.61.104:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0830 22:19:31.909095 995192 api_server.go:253] Checking apiserver healthz at https://192.168.61.104:8444/healthz ...
I0830 22:19:31.916778 995192 api_server.go:279] https://192.168.61.104:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0830 22:19:31.916813 995192 api_server.go:103] status: https://192.168.61.104:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0830 22:19:29.130983 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:29.131530 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:29.131565 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:29.131459 996676 retry.go:31] will retry after 951.657872ms: waiting for machine to come up
I0830 22:19:30.084853 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:30.085280 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:30.085306 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:30.085247 996676 retry.go:31] will retry after 1.469099841s: waiting for machine to come up
I0830 22:19:31.556432 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:31.556893 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:31.556918 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:31.556809 996676 retry.go:31] will retry after 1.217757948s: waiting for machine to come up
I0830 22:19:32.775796 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:32.776120 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:32.776152 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:32.776080 996676 retry.go:31] will retry after 2.032727742s: waiting for machine to come up
I0830 22:19:31.859924 995603 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (3.257478408s)
I0830 22:19:31.859957 995603 crio.go:451] Took 3.257622 seconds to extract the tarball
I0830 22:19:31.859970 995603 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0830 22:19:31.917027 995603 ssh_runner.go:195] Run: sudo crictl images --output json
I0830 22:19:31.965752 995603 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0830 22:19:31.965777 995603 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0830 22:19:31.965886 995603 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0830 22:19:31.965944 995603 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0830 22:19:31.965980 995603 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0830 22:19:31.965879 995603 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0830 22:19:31.966084 995603 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0830 22:19:31.965878 995603 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0830 22:19:31.965967 995603 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0830 22:19:31.965901 995603 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0830 22:19:31.968024 995603 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0830 22:19:31.968045 995603 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0830 22:19:31.968079 995603 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0830 22:19:31.968186 995603 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0830 22:19:31.968191 995603 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0830 22:19:31.968193 995603 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0830 22:19:31.968248 995603 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0830 22:19:31.968766 995603 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0830 22:19:32.140478 995603 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.16.0
I0830 22:19:32.140975 995603 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.3.15-0
I0830 22:19:32.157997 995603 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.1
I0830 22:19:32.159468 995603 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.16.0
I0830 22:19:32.159950 995603 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.16.0
I0830 22:19:32.160033 995603 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.16.0
I0830 22:19:32.161682 995603 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.2
I0830 22:19:32.255481 995603 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0830 22:19:32.261235 995603 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0830 22:19:32.261291 995603 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0830 22:19:32.261340 995603 ssh_runner.go:195] Run: which crictl
I0830 22:19:32.282724 995603 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0830 22:19:32.282781 995603 cri.go:218] Removing image: registry.k8s.io/etcd:3.3.15-0
I0830 22:19:32.282854 995603 ssh_runner.go:195] Run: which crictl
I0830 22:19:32.378268 995603 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0830 22:19:32.378372 995603 cri.go:218] Removing image: registry.k8s.io/pause:3.1
I0830 22:19:32.378417 995603 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0830 22:19:32.378507 995603 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.2
I0830 22:19:32.378551 995603 ssh_runner.go:195] Run: which crictl
I0830 22:19:32.378377 995603 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0830 22:19:32.378578 995603 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0830 22:19:32.378591 995603 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0830 22:19:32.378600 995603 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0830 22:19:32.378295 995603 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0830 22:19:32.378624 995603 ssh_runner.go:195] Run: which crictl
I0830 22:19:32.378632 995603 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0830 22:19:32.378439 995603 ssh_runner.go:195] Run: which crictl
I0830 22:19:32.378657 995603 ssh_runner.go:195] Run: which crictl
I0830 22:19:32.378624 995603 ssh_runner.go:195] Run: which crictl
I0830 22:19:32.468864 995603 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.16.0
I0830 22:19:32.468935 995603 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.3.15-0
I0830 22:19:32.469002 995603 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.16.0
I0830 22:19:32.469032 995603 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.2
I0830 22:19:32.469123 995603 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.16.0
I0830 22:19:32.469183 995603 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.1
I0830 22:19:32.469184 995603 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0830 22:19:32.563508 995603 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17114-955377/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0
I0830 22:19:32.563630 995603 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17114-955377/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.3.15-0
I0830 22:19:32.586962 995603 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17114-955377/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0
I0830 22:19:32.587044 995603 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17114-955377/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0
I0830 22:19:32.587059 995603 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17114-955377/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2
I0830 22:19:32.587115 995603 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17114-955377/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1
I0830 22:19:32.587208 995603 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.1
I0830 22:19:32.587265 995603 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17114-955377/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.16.0
I0830 22:19:32.592221 995603 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/pause_3.1 (exists)
I0830 22:19:32.592246 995603 crio.go:257] Loading image: /var/lib/minikube/images/pause_3.1
I0830 22:19:32.592300 995603 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/pause_3.1
I0830 22:19:34.254194 995603 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/pause_3.1: (1.661863162s)
I0830 22:19:34.254235 995603 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17114-955377/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1 from cache
I0830 22:19:34.254281 995603 cache_images.go:92] LoadImages completed in 2.288490025s
W0830 22:19:34.254418 995603 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17114-955377/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0: no such file or directory
I0830 22:19:34.254514 995603 ssh_runner.go:195] Run: crio config
I0830 22:19:34.338842 995603 cni.go:84] Creating CNI manager for ""
I0830 22:19:34.338876 995603 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0830 22:19:34.338903 995603 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0830 22:19:34.338929 995603 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.10 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-250163 NodeName:old-k8s-version-250163 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.10"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.10 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0830 22:19:34.339134 995603 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.10
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-250163"
kubeletExtraArgs:
node-ip: 192.168.39.10
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.10"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-250163
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.39.10:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0830 22:19:34.339240 995603 kubeadm.go:976] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-250163 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.10
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-250163 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0830 22:19:34.339313 995603 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0830 22:19:34.348990 995603 binaries.go:44] Found k8s binaries, skipping transfer
I0830 22:19:34.349076 995603 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0830 22:19:34.358084 995603 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0830 22:19:34.376989 995603 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0830 22:19:34.396552 995603 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2177 bytes)
I0830 22:19:34.416666 995603 ssh_runner.go:195] Run: grep 192.168.39.10 control-plane.minikube.internal$ /etc/hosts
I0830 22:19:34.421910 995603 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.10 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0830 22:19:34.436393 995603 certs.go:56] Setting up /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/old-k8s-version-250163 for IP: 192.168.39.10
I0830 22:19:34.436490 995603 certs.go:190] acquiring lock for shared ca certs: {Name:mk2e67e13d79d15c3d002a96b2a7f288fae16325 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0830 22:19:34.436717 995603 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/17114-955377/.minikube/ca.key
I0830 22:19:34.436774 995603 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/17114-955377/.minikube/proxy-client-ca.key
I0830 22:19:34.436867 995603 certs.go:315] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/old-k8s-version-250163/client.key
I0830 22:19:34.436944 995603 certs.go:315] skipping minikube signed cert generation: /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/old-k8s-version-250163/apiserver.key.713efbbe
I0830 22:19:34.437006 995603 certs.go:315] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/old-k8s-version-250163/proxy-client.key
I0830 22:19:34.437140 995603 certs.go:437] found cert: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/home/jenkins/minikube-integration/17114-955377/.minikube/certs/962621.pem (1338 bytes)
W0830 22:19:34.437187 995603 certs.go:433] ignoring /home/jenkins/minikube-integration/17114-955377/.minikube/certs/home/jenkins/minikube-integration/17114-955377/.minikube/certs/962621_empty.pem, impossibly tiny 0 bytes
I0830 22:19:34.437203 995603 certs.go:437] found cert: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem (1679 bytes)
I0830 22:19:34.437249 995603 certs.go:437] found cert: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem (1078 bytes)
I0830 22:19:34.437284 995603 certs.go:437] found cert: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem (1123 bytes)
I0830 22:19:34.437320 995603 certs.go:437] found cert: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem (1679 bytes)
I0830 22:19:34.437388 995603 certs.go:437] found cert: /home/jenkins/minikube-integration/17114-955377/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/17114-955377/.minikube/files/etc/ssl/certs/9626212.pem (1708 bytes)
I0830 22:19:34.438079 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/old-k8s-version-250163/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0830 22:19:34.470943 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/old-k8s-version-250163/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0830 22:19:34.503477 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/old-k8s-version-250163/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0830 22:19:34.533783 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/old-k8s-version-250163/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0830 22:19:34.562423 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0830 22:19:34.594418 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0830 22:19:34.625417 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0830 22:19:34.657444 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0830 22:19:34.689407 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/files/etc/ssl/certs/9626212.pem --> /usr/share/ca-certificates/9626212.pem (1708 bytes)
I0830 22:19:34.719004 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0830 22:19:34.745856 995603 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/certs/962621.pem --> /usr/share/ca-certificates/962621.pem (1338 bytes)
I0830 22:19:32.410110 995192 api_server.go:253] Checking apiserver healthz at https://192.168.61.104:8444/healthz ...
I0830 22:19:32.418241 995192 api_server.go:279] https://192.168.61.104:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0830 22:19:32.418269 995192 api_server.go:103] status: https://192.168.61.104:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0830 22:19:32.910053 995192 api_server.go:253] Checking apiserver healthz at https://192.168.61.104:8444/healthz ...
I0830 22:19:32.915839 995192 api_server.go:279] https://192.168.61.104:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0830 22:19:32.915870 995192 api_server.go:103] status: https://192.168.61.104:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0830 22:19:33.410086 995192 api_server.go:253] Checking apiserver healthz at https://192.168.61.104:8444/healthz ...
I0830 22:19:33.488115 995192 api_server.go:279] https://192.168.61.104:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0830 22:19:33.488161 995192 api_server.go:103] status: https://192.168.61.104:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0830 22:19:33.909647 995192 api_server.go:253] Checking apiserver healthz at https://192.168.61.104:8444/healthz ...
I0830 22:19:33.915252 995192 api_server.go:279] https://192.168.61.104:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0830 22:19:33.915284 995192 api_server.go:103] status: https://192.168.61.104:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0830 22:19:34.409978 995192 api_server.go:253] Checking apiserver healthz at https://192.168.61.104:8444/healthz ...
I0830 22:19:34.418957 995192 api_server.go:279] https://192.168.61.104:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0830 22:19:34.418995 995192 api_server.go:103] status: https://192.168.61.104:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0830 22:19:34.909561 995192 api_server.go:253] Checking apiserver healthz at https://192.168.61.104:8444/healthz ...
I0830 22:19:34.925400 995192 api_server.go:279] https://192.168.61.104:8444/healthz returned 200:
ok
I0830 22:19:34.938760 995192 api_server.go:141] control plane version: v1.28.1
I0830 22:19:34.938793 995192 api_server.go:131] duration metric: took 8.390990557s to wait for apiserver health ...
I0830 22:19:34.938804 995192 cni.go:84] Creating CNI manager for ""
I0830 22:19:34.938813 995192 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0830 22:19:34.941052 995192 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0830 22:19:34.942805 995192 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0830 22:19:34.967544 995192 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0830 22:19:34.998450 995192 system_pods.go:43] waiting for kube-system pods to appear ...
I0830 22:19:35.012600 995192 system_pods.go:59] 8 kube-system pods found
I0830 22:19:35.012681 995192 system_pods.go:61] "coredns-5dd5756b68-992p2" [83ad338b-0338-45c3-a5ed-f772d100046b] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0830 22:19:35.012702 995192 system_pods.go:61] "etcd-default-k8s-diff-port-791007" [4ed4f652-47c4-4d79-b8a8-dd0cc778bce0] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0830 22:19:35.012714 995192 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-791007" [c01b9dfc-ad6f-4348-abf0-fde4a64bfa98] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0830 22:19:35.012732 995192 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-791007" [94cbccaf-3d5a-480c-8ee0-b8af5030909d] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0830 22:19:35.012748 995192 system_pods.go:61] "kube-proxy-vckmf" [03f05466-f99b-4803-9164-233bfb9e7bb3] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0830 22:19:35.012760 995192 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-791007" [2c5e190d-c93b-400a-8538-e31cc2016cc2] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0830 22:19:35.012774 995192 system_pods.go:61] "metrics-server-57f55c9bc5-p8pp2" [4eaff1be-4258-427b-a110-47dabbffecee] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0830 22:19:35.012788 995192 system_pods.go:61] "storage-provisioner" [8db3da8b-8256-405d-8d9c-79fdb6da8ab2] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0830 22:19:35.012800 995192 system_pods.go:74] duration metric: took 14.324835ms to wait for pod list to return data ...
I0830 22:19:35.012814 995192 node_conditions.go:102] verifying NodePressure condition ...
I0830 22:19:35.024186 995192 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0830 22:19:35.024216 995192 node_conditions.go:123] node cpu capacity is 2
I0830 22:19:35.024229 995192 node_conditions.go:105] duration metric: took 11.409776ms to run NodePressure ...
I0830 22:19:35.024284 995192 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0830 22:19:35.318824 995192 kubeadm.go:772] waiting for restarted kubelet to initialise ...
I0830 22:19:35.324484 995192 kubeadm.go:787] kubelet initialised
I0830 22:19:35.324512 995192 kubeadm.go:788] duration metric: took 5.656923ms waiting for restarted kubelet to initialise ...
I0830 22:19:35.324525 995192 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0830 22:19:35.334137 995192 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-992p2" in "kube-system" namespace to be "Ready" ...
I0830 22:19:34.810276 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:34.810797 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:34.810836 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:34.810732 996676 retry.go:31] will retry after 2.550508742s: waiting for machine to come up
I0830 22:19:37.364002 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:37.364550 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:37.364582 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:37.364489 996676 retry.go:31] will retry after 2.230782644s: waiting for machine to come up
I0830 22:19:34.771235 995603 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0830 22:19:34.787672 995603 ssh_runner.go:195] Run: openssl version
I0830 22:19:34.793400 995603 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9626212.pem && ln -fs /usr/share/ca-certificates/9626212.pem /etc/ssl/certs/9626212.pem"
I0830 22:19:34.803208 995603 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9626212.pem
I0830 22:19:34.808108 995603 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Aug 30 21:18 /usr/share/ca-certificates/9626212.pem
I0830 22:19:34.808166 995603 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9626212.pem
I0830 22:19:34.814296 995603 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/9626212.pem /etc/ssl/certs/3ec20f2e.0"
I0830 22:19:34.824791 995603 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0830 22:19:34.838527 995603 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0830 22:19:34.844726 995603 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Aug 30 21:10 /usr/share/ca-certificates/minikubeCA.pem
I0830 22:19:34.844789 995603 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0830 22:19:34.852442 995603 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0830 22:19:34.862510 995603 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/962621.pem && ln -fs /usr/share/ca-certificates/962621.pem /etc/ssl/certs/962621.pem"
I0830 22:19:34.875456 995603 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/962621.pem
I0830 22:19:34.880581 995603 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Aug 30 21:18 /usr/share/ca-certificates/962621.pem
I0830 22:19:34.880702 995603 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/962621.pem
I0830 22:19:34.886591 995603 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/962621.pem /etc/ssl/certs/51391683.0"
I0830 22:19:34.897133 995603 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I0830 22:19:34.902292 995603 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0830 22:19:34.908905 995603 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0830 22:19:34.915276 995603 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0830 22:19:34.921204 995603 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0830 22:19:34.927878 995603 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0830 22:19:34.934091 995603 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0830 22:19:34.940851 995603 kubeadm.go:404] StartCluster: {Name:old-k8s-version-250163 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17120/minikube-v1.31.0-1692872107-17120-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1692872184-17120@sha256:42602f0d347faca66d9347bdc33243fe5f4d6b3fff3ba53f3b2fc2d5fe63e9ec Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe
rsion:v1.16.0 ClusterName:old-k8s-version-250163 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.10 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertE
xpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
I0830 22:19:34.940966 995603 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0830 22:19:34.941036 995603 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0830 22:19:34.978950 995603 cri.go:89] found id: ""
I0830 22:19:34.979038 995603 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0830 22:19:34.988290 995603 kubeadm.go:419] found existing configuration files, will attempt cluster restart
I0830 22:19:34.988324 995603 kubeadm.go:636] restartCluster start
I0830 22:19:34.988403 995603 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0830 22:19:34.998277 995603 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0830 22:19:34.999385 995603 kubeconfig.go:92] found "old-k8s-version-250163" server: "https://192.168.39.10:8443"
I0830 22:19:35.002017 995603 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0830 22:19:35.013903 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:35.013962 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:35.028780 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:35.028800 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:35.028845 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:35.043243 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:35.543986 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:35.544109 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:35.555939 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:36.044164 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:36.044259 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:36.055496 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:36.544110 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:36.544243 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:36.555999 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:37.043535 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:37.043628 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:37.055019 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:37.543435 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:37.543546 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:37.558778 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:38.044367 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:38.044482 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:38.058777 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:38.543327 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:38.543431 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:38.555133 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:39.043720 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:39.043874 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:39.059955 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:39.543461 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:39.543625 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:39.558707 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:37.360241 995192 pod_ready.go:102] pod "coredns-5dd5756b68-992p2" in "kube-system" namespace has status "Ready":"False"
I0830 22:19:39.363755 995192 pod_ready.go:102] pod "coredns-5dd5756b68-992p2" in "kube-system" namespace has status "Ready":"False"
I0830 22:19:40.357373 995192 pod_ready.go:92] pod "coredns-5dd5756b68-992p2" in "kube-system" namespace has status "Ready":"True"
I0830 22:19:40.357396 995192 pod_ready.go:81] duration metric: took 5.023230161s waiting for pod "coredns-5dd5756b68-992p2" in "kube-system" namespace to be "Ready" ...
I0830 22:19:40.357409 995192 pod_ready.go:78] waiting up to 4m0s for pod "etcd-default-k8s-diff-port-791007" in "kube-system" namespace to be "Ready" ...
I0830 22:19:39.597197 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:39.597650 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:39.597684 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:39.597603 996676 retry.go:31] will retry after 3.562835127s: waiting for machine to come up
I0830 22:19:43.161572 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:43.162020 994624 main.go:141] libmachine: (no-preload-698195) DBG | unable to find current IP address of domain no-preload-698195 in network mk-no-preload-698195
I0830 22:19:43.162054 994624 main.go:141] libmachine: (no-preload-698195) DBG | I0830 22:19:43.161973 996676 retry.go:31] will retry after 5.409514109s: waiting for machine to come up
I0830 22:19:40.044014 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:40.044104 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:40.059377 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:40.543910 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:40.544012 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:40.555295 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:41.043380 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:41.043493 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:41.055443 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:41.544046 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:41.544121 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:41.555832 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:42.043785 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:42.043876 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:42.054809 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:42.543376 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:42.543463 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:42.554254 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:43.043435 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:43.043543 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:43.054734 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:43.544308 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:43.544418 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:43.555603 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:44.044211 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:44.044291 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:44.055403 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:44.544013 995603 api_server.go:166] Checking apiserver status ...
I0830 22:19:44.544117 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0830 22:19:44.555197 995603 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0830 22:19:42.378396 995192 pod_ready.go:102] pod "etcd-default-k8s-diff-port-791007" in "kube-system" namespace has status "Ready":"False"
I0830 22:19:42.881428 995192 pod_ready.go:92] pod "etcd-default-k8s-diff-port-791007" in "kube-system" namespace has status "Ready":"True"
I0830 22:19:42.881456 995192 pod_ready.go:81] duration metric: took 2.524040213s waiting for pod "etcd-default-k8s-diff-port-791007" in "kube-system" namespace to be "Ready" ...
I0830 22:19:42.881467 995192 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-default-k8s-diff-port-791007" in "kube-system" namespace to be "Ready" ...
I0830 22:19:42.892688 995192 pod_ready.go:92] pod "kube-apiserver-default-k8s-diff-port-791007" in "kube-system" namespace has status "Ready":"True"
I0830 22:19:42.892718 995192 pod_ready.go:81] duration metric: took 11.243576ms waiting for pod "kube-apiserver-default-k8s-diff-port-791007" in "kube-system" namespace to be "Ready" ...
I0830 22:19:42.892731 995192 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-default-k8s-diff-port-791007" in "kube-system" namespace to be "Ready" ...
I0830 22:19:42.898434 995192 pod_ready.go:92] pod "kube-controller-manager-default-k8s-diff-port-791007" in "kube-system" namespace has status "Ready":"True"
I0830 22:19:42.898463 995192 pod_ready.go:81] duration metric: took 5.721888ms waiting for pod "kube-controller-manager-default-k8s-diff-port-791007" in "kube-system" namespace to be "Ready" ...
I0830 22:19:42.898476 995192 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-vckmf" in "kube-system" namespace to be "Ready" ...
I0830 22:19:42.904261 995192 pod_ready.go:92] pod "kube-proxy-vckmf" in "kube-system" namespace has status "Ready":"True"
I0830 22:19:42.904287 995192 pod_ready.go:81] duration metric: took 5.803127ms waiting for pod "kube-proxy-vckmf" in "kube-system" namespace to be "Ready" ...
I0830 22:19:42.904299 995192 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-default-k8s-diff-port-791007" in "kube-system" namespace to be "Ready" ...
I0830 22:19:43.153736 995192 pod_ready.go:92] pod "kube-scheduler-default-k8s-diff-port-791007" in "kube-system" namespace has status "Ready":"True"
I0830 22:19:43.153763 995192 pod_ready.go:81] duration metric: took 249.454932ms waiting for pod "kube-scheduler-default-k8s-diff-port-791007" in "kube-system" namespace to be "Ready" ...
I0830 22:19:43.153777 995192 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-p8pp2" in "kube-system" namespace to be "Ready" ...
I0830 22:19:45.462667 995192 pod_ready.go:102] pod "metrics-server-57f55c9bc5-p8pp2" in "kube-system" namespace has status "Ready":"False"
I0830 22:19:48.575718 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:48.576172 994624 main.go:141] libmachine: (no-preload-698195) Found IP for machine: 192.168.72.28
I0830 22:19:48.576206 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has current primary IP address 192.168.72.28 and MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:48.576217 994624 main.go:141] libmachine: (no-preload-698195) Reserving static IP address...
I0830 22:19:48.576671 994624 main.go:141] libmachine: (no-preload-698195) DBG | found host DHCP lease matching {name: "no-preload-698195", mac: "52:54:00:5b:fc:d1", ip: "192.168.72.28"} in network mk-no-preload-698195: {Iface:virbr4 ExpiryTime:2023-08-30 23:19:38 +0000 UTC Type:0 Mac:52:54:00:5b:fc:d1 Iaid: IPaddr:192.168.72.28 Prefix:24 Hostname:no-preload-698195 Clientid:01:52:54:00:5b:fc:d1}
I0830 22:19:48.576719 994624 main.go:141] libmachine: (no-preload-698195) Reserved static IP address: 192.168.72.28
I0830 22:19:48.576754 994624 main.go:141] libmachine: (no-preload-698195) DBG | skip adding static IP to network mk-no-preload-698195 - found existing host DHCP lease matching {name: "no-preload-698195", mac: "52:54:00:5b:fc:d1", ip: "192.168.72.28"}
I0830 22:19:48.576776 994624 main.go:141] libmachine: (no-preload-698195) DBG | Getting to WaitForSSH function...
I0830 22:19:48.576792 994624 main.go:141] libmachine: (no-preload-698195) Waiting for SSH to be available...
I0830 22:19:48.578953 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:48.579261 994624 main.go:141] libmachine: (no-preload-698195) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:fc:d1", ip: ""} in network mk-no-preload-698195: {Iface:virbr4 ExpiryTime:2023-08-30 23:19:38 +0000 UTC Type:0 Mac:52:54:00:5b:fc:d1 Iaid: IPaddr:192.168.72.28 Prefix:24 Hostname:no-preload-698195 Clientid:01:52:54:00:5b:fc:d1}
I0830 22:19:48.579290 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined IP address 192.168.72.28 and MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:48.579398 994624 main.go:141] libmachine: (no-preload-698195) DBG | Using SSH client type: external
I0830 22:19:48.579417 994624 main.go:141] libmachine: (no-preload-698195) DBG | Using SSH private key: /home/jenkins/minikube-integration/17114-955377/.minikube/machines/no-preload-698195/id_rsa (-rw-------)
I0830 22:19:48.579451 994624 main.go:141] libmachine: (no-preload-698195) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.28 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17114-955377/.minikube/machines/no-preload-698195/id_rsa -p 22] /usr/bin/ssh <nil>}
I0830 22:19:48.579478 994624 main.go:141] libmachine: (no-preload-698195) DBG | About to run SSH command:
I0830 22:19:48.579493 994624 main.go:141] libmachine: (no-preload-698195) DBG | exit 0
I0830 22:19:48.679834 994624 main.go:141] libmachine: (no-preload-698195) DBG | SSH cmd err, output: <nil>:
I0830 22:19:48.680237 994624 main.go:141] libmachine: (no-preload-698195) Calling .GetConfigRaw
I0830 22:19:48.681064 994624 main.go:141] libmachine: (no-preload-698195) Calling .GetIP
I0830 22:19:48.683388 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:48.683844 994624 main.go:141] libmachine: (no-preload-698195) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:fc:d1", ip: ""} in network mk-no-preload-698195: {Iface:virbr4 ExpiryTime:2023-08-30 23:19:38 +0000 UTC Type:0 Mac:52:54:00:5b:fc:d1 Iaid: IPaddr:192.168.72.28 Prefix:24 Hostname:no-preload-698195 Clientid:01:52:54:00:5b:fc:d1}
I0830 22:19:48.683884 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined IP address 192.168.72.28 and MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:48.684153 994624 profile.go:148] Saving config to /home/jenkins/minikube-integration/17114-955377/.minikube/profiles/no-preload-698195/config.json ...
I0830 22:19:48.684435 994624 machine.go:88] provisioning docker machine ...
I0830 22:19:48.684462 994624 main.go:141] libmachine: (no-preload-698195) Calling .DriverName
I0830 22:19:48.684708 994624 main.go:141] libmachine: (no-preload-698195) Calling .GetMachineName
I0830 22:19:48.684851 994624 buildroot.go:166] provisioning hostname "no-preload-698195"
I0830 22:19:48.684883 994624 main.go:141] libmachine: (no-preload-698195) Calling .GetMachineName
I0830 22:19:48.685013 994624 main.go:141] libmachine: (no-preload-698195) Calling .GetSSHHostname
I0830 22:19:48.687508 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:48.687975 994624 main.go:141] libmachine: (no-preload-698195) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:fc:d1", ip: ""} in network mk-no-preload-698195: {Iface:virbr4 ExpiryTime:2023-08-30 23:19:38 +0000 UTC Type:0 Mac:52:54:00:5b:fc:d1 Iaid: IPaddr:192.168.72.28 Prefix:24 Hostname:no-preload-698195 Clientid:01:52:54:00:5b:fc:d1}
I0830 22:19:48.688018 994624 main.go:141] libmachine: (no-preload-698195) DBG | domain no-preload-698195 has defined IP address 192.168.72.28 and MAC address 52:54:00:5b:fc:d1 in network mk-no-preload-698195
I0830 22:19:48.688198 994624 main.go:141] libmachine: (no-preload-698195) Calling .GetSSHPort
I0830 22:19:48.688413 994624 main.go:141] libmachine: (no-preload-698195) Calling .GetSSHKeyPath
I0830 22:19:48.688599 994624 main.go:141] libmachine: (no-preload-698195) Calling .GetSSHKeyPath
I0830 22:19:48.688830 994624 main.go:141] libmachine: (no-preload-698195) Calling .GetSSHUsername
I0830 22:19:48.689061 994624 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:48.689695 994624 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.72.28 22 <nil> <nil>}
I0830 22:19:48.689718 994624 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-698195 && echo "no-preload-698195" | sudo tee /etc/hostname
I0830 22:19:45.014985 995603 kubeadm.go:611] needs reconfigure: apiserver error: context deadline exceeded
I0830 22:19:45.015030 995603 kubeadm.go:1128] stopping kube-system containers ...
I0830 22:19:45.015045 995603 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0830 22:19:45.015102 995603 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0830 22:19:45.049952 995603 cri.go:89] found id: ""
I0830 22:19:45.050039 995603 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0830 22:19:45.065202 995603 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0830 22:19:45.074198 995603 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0830 22:19:45.074330 995603 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0830 22:19:45.083407 995603 kubeadm.go:713] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
I0830 22:19:45.083438 995603 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0830 22:19:45.211527 995603 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0830 22:19:46.256339 995603 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.044735651s)
I0830 22:19:46.256389 995603 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0830 22:19:46.469714 995603 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0830 22:19:46.542945 995603 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0830 22:19:46.644533 995603 api_server.go:52] waiting for apiserver process to appear ...
I0830 22:19:46.644632 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0830 22:19:46.659432 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0830 22:19:47.182415 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0830 22:19:47.682613 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0830 22:19:48.182661 995603 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0830 22:19:48.206336 995603 api_server.go:72] duration metric: took 1.561801361s to wait for apiserver process to appear ...
I0830 22:19:48.206374 995603 api_server.go:88] waiting for apiserver healthz status ...
I0830 22:19:48.206399 995603 api_server.go:253] Checking apiserver healthz at https://192.168.39.10:8443/healthz ...
I0830 22:19:50.136893 994705 start.go:369] acquired machines lock for "embed-certs-208903" in 1m0.108561967s
I0830 22:19:50.136941 994705 start.go:96] Skipping create...Using existing machine configuration
I0830 22:19:50.136952 994705 fix.go:54] fixHost starting:
I0830 22:19:50.137347 994705 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0830 22:19:50.137386 994705 main.go:141] libmachine: Launching plugin server for driver kvm2
I0830 22:19:50.156678 994705 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42209
I0830 22:19:50.157148 994705 main.go:141] libmachine: () Calling .GetVersion
I0830 22:19:50.157739 994705 main.go:141] libmachine: Using API Version 1
I0830 22:19:50.157765 994705 main.go:141] libmachine: () Calling .SetConfigRaw
I0830 22:19:50.158103 994705 main.go:141] libmachine: () Calling .GetMachineName
I0830 22:19:50.158283 994705 main.go:141] libmachine: (embed-certs-208903) Calling .DriverName
I0830 22:19:50.158445 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetState
I0830 22:19:50.160098 994705 fix.go:102] recreateIfNeeded on embed-certs-208903: state=Running err=<nil>
W0830 22:19:50.160115 994705 fix.go:128] unexpected machine state, will restart: <nil>
I0830 22:19:50.162162 994705 out.go:177] * Updating the running kvm2 "embed-certs-208903" VM ...
I0830 22:19:50.163634 994705 machine.go:88] provisioning docker machine ...
I0830 22:19:50.163663 994705 main.go:141] libmachine: (embed-certs-208903) Calling .DriverName
I0830 22:19:50.163906 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetMachineName
I0830 22:19:50.164077 994705 buildroot.go:166] provisioning hostname "embed-certs-208903"
I0830 22:19:50.164104 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetMachineName
I0830 22:19:50.164288 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:19:50.166831 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.167198 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:19:50.167234 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.167371 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:19:50.167561 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.167731 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.167902 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:19:50.168108 994705 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:50.168592 994705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.50.159 22 <nil> <nil>}
I0830 22:19:50.168610 994705 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-208903 && echo "embed-certs-208903" | sudo tee /etc/hostname
I0830 22:19:50.306738 994705 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-208903
I0830 22:19:50.306772 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:19:50.309523 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.309929 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:19:50.309974 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.310182 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:19:50.310349 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.310638 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.310845 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:19:50.311027 994705 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:50.311610 994705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.50.159 22 <nil> <nil>}
I0830 22:19:50.311644 994705 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-208903' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-208903/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-208903' | sudo tee -a /etc/hosts;
fi
fi
I0830 22:19:50.433972 994705 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0830 22:19:50.434005 994705 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17114-955377/.minikube CaCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17114-955377/.minikube}
I0830 22:19:50.434045 994705 buildroot.go:174] setting up certificates
I0830 22:19:50.434057 994705 provision.go:83] configureAuth start
I0830 22:19:50.434069 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetMachineName
I0830 22:19:50.434388 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetIP
I0830 22:19:50.437450 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.437883 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:19:50.437916 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.438115 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:19:50.440654 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.441014 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:19:50.441059 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.441213 994705 provision.go:138] copyHostCerts
I0830 22:19:50.441271 994705 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem, removing ...
I0830 22:19:50.441283 994705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem
I0830 22:19:50.441352 994705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/ca.pem (1078 bytes)
I0830 22:19:50.441453 994705 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem, removing ...
I0830 22:19:50.441462 994705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem
I0830 22:19:50.441481 994705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/cert.pem (1123 bytes)
I0830 22:19:50.441563 994705 exec_runner.go:144] found /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem, removing ...
I0830 22:19:50.441575 994705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem
I0830 22:19:50.441606 994705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17114-955377/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17114-955377/.minikube/key.pem (1679 bytes)
I0830 22:19:50.441684 994705 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca-key.pem org=jenkins.embed-certs-208903 san=[192.168.50.159 192.168.50.159 localhost 127.0.0.1 minikube embed-certs-208903]
I0830 22:19:50.721978 994705 provision.go:172] copyRemoteCerts
I0830 22:19:50.722039 994705 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0830 22:19:50.722072 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:19:50.724893 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.725257 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:19:50.725289 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.725571 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:19:50.725799 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.726014 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:19:50.726181 994705 sshutil.go:53] new ssh client: &{IP:192.168.50.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17114-955377/.minikube/machines/embed-certs-208903/id_rsa Username:docker}
I0830 22:19:50.817217 994705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0830 22:19:50.843335 994705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server.pem --> /etc/docker/server.pem (1229 bytes)
I0830 22:19:50.869233 994705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17114-955377/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0830 22:19:50.897508 994705 provision.go:86] duration metric: configureAuth took 463.432948ms
I0830 22:19:50.897544 994705 buildroot.go:189] setting minikube options for container-runtime
I0830 22:19:50.897804 994705 config.go:182] Loaded profile config "embed-certs-208903": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.1
I0830 22:19:50.897904 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHHostname
I0830 22:19:50.900633 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.901014 994705 main.go:141] libmachine: (embed-certs-208903) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:07:50:90", ip: ""} in network mk-embed-certs-208903: {Iface:virbr2 ExpiryTime:2023-08-30 23:18:38 +0000 UTC Type:0 Mac:52:54:00:07:50:90 Iaid: IPaddr:192.168.50.159 Prefix:24 Hostname:embed-certs-208903 Clientid:01:52:54:00:07:50:90}
I0830 22:19:50.901040 994705 main.go:141] libmachine: (embed-certs-208903) DBG | domain embed-certs-208903 has defined IP address 192.168.50.159 and MAC address 52:54:00:07:50:90 in network mk-embed-certs-208903
I0830 22:19:50.901210 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHPort
I0830 22:19:50.901404 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.901547 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHKeyPath
I0830 22:19:50.901680 994705 main.go:141] libmachine: (embed-certs-208903) Calling .GetSSHUsername
I0830 22:19:50.901875 994705 main.go:141] libmachine: Using SSH client type: native
I0830 22:19:50.902287 994705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80fd20] 0x812dc0 <nil> [] 0s} 192.168.50.159 22 <nil> <nil>}
I0830 22:19:50.902310 994705 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0830 22:19:51.128816 994705 main.go:141] libmachine: SSH cmd err, output: Process exited with status 1:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
I0830 22:19:51.128855 994705 buildroot.go:191] Error setting container-runtime options during provisioning ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
I0830 22:19:51.128866 994705 machine.go:91] provisioned docker machine in 965.212906ms
I0830 22:19:51.128900 994705 fix.go:56] fixHost completed within 991.948899ms
I0830 22:19:51.128906 994705 start.go:83] releasing machines lock for "embed-certs-208903", held for 991.990648ms
W0830 22:19:51.129050 994705 out.go:239] * Failed to start kvm2 VM. Running "minikube delete -p embed-certs-208903" may fix it: provision: ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
I0830 22:19:51.131823 994705 out.go:177]
W0830 22:19:51.133957 994705 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: provision: ssh command error:
command : sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
err : Process exited with status 1
output :
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
A dependency job for crio.service failed. See 'journalctl -xe' for details.
W0830 22:19:51.133985 994705 out.go:239] *
W0830 22:19:51.134788 994705 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0830 22:19:51.136212 994705 out.go:177]
*
* ==> CRI-O <==
* -- Journal begins at Wed 2023-08-30 22:18:37 UTC, ends at Wed 2023-08-30 22:20:40 UTC. --
Aug 30 22:18:39 minikube systemd[1]: Dependency failed for Container Runtime Interface for OCI (CRI-O).
Aug 30 22:18:39 minikube systemd[1]: crio.service: Job crio.service/start failed with result 'dependency'.
Aug 30 22:18:44 embed-certs-208903 systemd[1]: Dependency failed for Container Runtime Interface for OCI (CRI-O).
Aug 30 22:18:44 embed-certs-208903 systemd[1]: crio.service: Job crio.service/start failed with result 'dependency'.
Aug 30 22:19:51 embed-certs-208903 systemd[1]: Dependency failed for Container Runtime Interface for OCI (CRI-O).
Aug 30 22:19:51 embed-certs-208903 systemd[1]: crio.service: Job crio.service/start failed with result 'dependency'.
*
* ==> container status <==
*
* ==> describe nodes <==
*
* ==> dmesg <==
* [Aug30 22:18] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.072921] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.305428] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.387854] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.153721] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +2.490379] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000018] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)
*
* ==> kernel <==
* 22:20:46 up 2 min, 0 users, load average: 0.02, 0.02, 0.00
Linux embed-certs-208903 5.10.57 #1 SMP Thu Aug 24 14:58:46 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
*
* ==> kubelet <==
* -- Journal begins at Wed 2023-08-30 22:18:37 UTC, ends at Wed 2023-08-30 22:20:46 UTC. --
-- No entries --
-- /stdout --
** stderr **
E0830 22:19:57.789552 996952 logs.go:281] Failed to list containers for "kube-apiserver": crictl list: sudo crictl ps -a --quiet --name=kube-apiserver: Process exited with status 1
stdout:
stderr:
time="2023-08-30T22:19:51Z" level=warning msg="runtime connect using default endpoints: [unix:///var/run/dockershim.sock unix:///run/containerd/containerd.sock unix:///run/crio/crio.sock]. As the default settings are now deprecated, you should set the endpoint instead."
time="2023-08-30T22:19:53Z" level=error msg="connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:19:55Z" level=error msg="connect endpoint 'unix:///run/containerd/containerd.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:19:57Z" level=fatal msg="connect: connect endpoint 'unix:///run/crio/crio.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
E0830 22:20:03.827311 996952 logs.go:281] Failed to list containers for "etcd": crictl list: sudo crictl ps -a --quiet --name=etcd: Process exited with status 1
stdout:
stderr:
time="2023-08-30T22:19:57Z" level=warning msg="runtime connect using default endpoints: [unix:///var/run/dockershim.sock unix:///run/containerd/containerd.sock unix:///run/crio/crio.sock]. As the default settings are now deprecated, you should set the endpoint instead."
time="2023-08-30T22:19:59Z" level=error msg="connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:01Z" level=error msg="connect endpoint 'unix:///run/containerd/containerd.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:03Z" level=fatal msg="connect: connect endpoint 'unix:///run/crio/crio.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
E0830 22:20:09.861226 996952 logs.go:281] Failed to list containers for "coredns": crictl list: sudo crictl ps -a --quiet --name=coredns: Process exited with status 1
stdout:
stderr:
time="2023-08-30T22:20:03Z" level=warning msg="runtime connect using default endpoints: [unix:///var/run/dockershim.sock unix:///run/containerd/containerd.sock unix:///run/crio/crio.sock]. As the default settings are now deprecated, you should set the endpoint instead."
time="2023-08-30T22:20:05Z" level=error msg="connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:07Z" level=error msg="connect endpoint 'unix:///run/containerd/containerd.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:09Z" level=fatal msg="connect: connect endpoint 'unix:///run/crio/crio.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
E0830 22:20:15.894742 996952 logs.go:281] Failed to list containers for "kube-scheduler": crictl list: sudo crictl ps -a --quiet --name=kube-scheduler: Process exited with status 1
stdout:
stderr:
time="2023-08-30T22:20:09Z" level=warning msg="runtime connect using default endpoints: [unix:///var/run/dockershim.sock unix:///run/containerd/containerd.sock unix:///run/crio/crio.sock]. As the default settings are now deprecated, you should set the endpoint instead."
time="2023-08-30T22:20:11Z" level=error msg="connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:13Z" level=error msg="connect endpoint 'unix:///run/containerd/containerd.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:15Z" level=fatal msg="connect: connect endpoint 'unix:///run/crio/crio.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
E0830 22:20:21.924689 996952 logs.go:281] Failed to list containers for "kube-proxy": crictl list: sudo crictl ps -a --quiet --name=kube-proxy: Process exited with status 1
stdout:
stderr:
time="2023-08-30T22:20:15Z" level=warning msg="runtime connect using default endpoints: [unix:///var/run/dockershim.sock unix:///run/containerd/containerd.sock unix:///run/crio/crio.sock]. As the default settings are now deprecated, you should set the endpoint instead."
time="2023-08-30T22:20:17Z" level=error msg="connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:19Z" level=error msg="connect endpoint 'unix:///run/containerd/containerd.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:21Z" level=fatal msg="connect: connect endpoint 'unix:///run/crio/crio.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
E0830 22:20:27.960587 996952 logs.go:281] Failed to list containers for "kube-controller-manager": crictl list: sudo crictl ps -a --quiet --name=kube-controller-manager: Process exited with status 1
stdout:
stderr:
time="2023-08-30T22:20:21Z" level=warning msg="runtime connect using default endpoints: [unix:///var/run/dockershim.sock unix:///run/containerd/containerd.sock unix:///run/crio/crio.sock]. As the default settings are now deprecated, you should set the endpoint instead."
time="2023-08-30T22:20:23Z" level=error msg="connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:25Z" level=error msg="connect endpoint 'unix:///run/containerd/containerd.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:27Z" level=fatal msg="connect: connect endpoint 'unix:///run/crio/crio.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
E0830 22:20:33.990227 996952 logs.go:281] Failed to list containers for "kindnet": crictl list: sudo crictl ps -a --quiet --name=kindnet: Process exited with status 1
stdout:
stderr:
time="2023-08-30T22:20:27Z" level=warning msg="runtime connect using default endpoints: [unix:///var/run/dockershim.sock unix:///run/containerd/containerd.sock unix:///run/crio/crio.sock]. As the default settings are now deprecated, you should set the endpoint instead."
time="2023-08-30T22:20:29Z" level=error msg="connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:31Z" level=error msg="connect endpoint 'unix:///run/containerd/containerd.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:33Z" level=fatal msg="connect: connect endpoint 'unix:///run/crio/crio.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
E0830 22:20:40.023435 996952 logs.go:281] Failed to list containers for "storage-provisioner": crictl list: sudo crictl ps -a --quiet --name=storage-provisioner: Process exited with status 1
stdout:
stderr:
time="2023-08-30T22:20:34Z" level=warning msg="runtime connect using default endpoints: [unix:///var/run/dockershim.sock unix:///run/containerd/containerd.sock unix:///run/crio/crio.sock]. As the default settings are now deprecated, you should set the endpoint instead."
time="2023-08-30T22:20:36Z" level=error msg="connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:38Z" level=error msg="connect endpoint 'unix:///run/containerd/containerd.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:40Z" level=fatal msg="connect: connect endpoint 'unix:///run/crio/crio.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
E0830 22:20:46.106324 996952 logs.go:195] command /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" failed with error: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": Process exited with status 1
stdout:
stderr:
time="2023-08-30T22:20:40Z" level=warning msg="runtime connect using default endpoints: [unix:///var/run/dockershim.sock unix:///run/containerd/containerd.sock unix:///run/crio/crio.sock]. As the default settings are now deprecated, you should set the endpoint instead."
time="2023-08-30T22:20:42Z" level=error msg="connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:44Z" level=error msg="connect endpoint 'unix:///run/containerd/containerd.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
time="2023-08-30T22:20:46Z" level=fatal msg="connect: connect endpoint 'unix:///run/crio/crio.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
output: "\n** stderr ** \ntime=\"2023-08-30T22:20:40Z\" level=warning msg=\"runtime connect using default endpoints: [unix:///var/run/dockershim.sock unix:///run/containerd/containerd.sock unix:///run/crio/crio.sock]. As the default settings are now deprecated, you should set the endpoint instead.\"\ntime=\"2023-08-30T22:20:42Z\" level=error msg=\"connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded\"\ntime=\"2023-08-30T22:20:44Z\" level=error msg=\"connect endpoint 'unix:///run/containerd/containerd.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded\"\ntime=\"2023-08-30T22:20:46Z\" level=fatal msg=\"connect: connect endpoint 'unix:///run/crio/crio.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded\"\nCannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?\n\n** /st
derr **"
E0830 22:20:46.254133 996952 logs.go:195] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E0830 22:20:46.240809 559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0830 22:20:46.241367 559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0830 22:20:46.243285 559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0830 22:20:46.244690 559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0830 22:20:46.246055 559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output: "\n** stderr ** \nE0830 22:20:46.240809 559 memcache.go:265] couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp 127.0.0.1:8443: connect: connection refused\nE0830 22:20:46.241367 559 memcache.go:265] couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp 127.0.0.1:8443: connect: connection refused\nE0830 22:20:46.243285 559 memcache.go:265] couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp 127.0.0.1:8443: connect: connection refused\nE0830 22:20:46.244690 559 memcache.go:265] couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp 127.0.0.1:8443: connect: connection refused\nE0830 22:20:46.246055 559 memcache.go:265] couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp 127.0.0.1:8443: connect: connection refused\nThe connection to the s
erver localhost:8443 was refused - did you specify the right host or port?\n\n** /stderr **"
! unable to fetch logs for: container status, describe nodes
** /stderr **
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-208903 -n embed-certs-208903
helpers_test.go:254: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-208903 -n embed-certs-208903: exit status 2 (254.291507ms)
-- stdout --
Stopped
-- /stdout --
helpers_test.go:254: status error: exit status 2 (may be ok)
helpers_test.go:256: "embed-certs-208903" apiserver is not running, skipping kubectl commands (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/SecondStart (410.04s)