=== RUN TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade
=== CONT TestKubernetesUpgrade
version_upgrade_test.go:235: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-518545 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=kvm2
version_upgrade_test.go:235: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-518545 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=kvm2 : (1m38.178346847s)
version_upgrade_test.go:240: (dbg) Run: out/minikube-linux-amd64 stop -p kubernetes-upgrade-518545
version_upgrade_test.go:240: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-518545: (3.287597125s)
version_upgrade_test.go:245: (dbg) Run: out/minikube-linux-amd64 -p kubernetes-upgrade-518545 status --format={{.Host}}
version_upgrade_test.go:245: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-518545 status --format={{.Host}}: exit status 7 (145.034781ms)
-- stdout --
Stopped
-- /stdout --
version_upgrade_test.go:247: status error: exit status 7 (may be ok)
version_upgrade_test.go:256: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-518545 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=kvm2
version_upgrade_test.go:256: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-518545 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=kvm2 : exit status 90 (26.045056115s)
-- stdout --
* [kubernetes-upgrade-518545] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=17837
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17837-52368/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17837-52368/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on existing profile
* Starting control plane node kubernetes-upgrade-518545 in cluster kubernetes-upgrade-518545
* Restarting existing kvm2 VM for "kubernetes-upgrade-518545" ...
-- /stdout --
** stderr **
I1219 19:22:05.046228 76463 out.go:296] Setting OutFile to fd 1 ...
I1219 19:22:05.046574 76463 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1219 19:22:05.046611 76463 out.go:309] Setting ErrFile to fd 2...
I1219 19:22:05.046631 76463 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1219 19:22:05.047152 76463 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17837-52368/.minikube/bin
I1219 19:22:05.048055 76463 out.go:303] Setting JSON to false
I1219 19:22:05.049429 76463 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-12","uptime":7478,"bootTime":1703006247,"procs":234,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1047-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1219 19:22:05.049572 76463 start.go:138] virtualization: kvm guest
I1219 19:22:05.052499 76463 out.go:177] * [kubernetes-upgrade-518545] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I1219 19:22:05.054203 76463 out.go:177] - MINIKUBE_LOCATION=17837
I1219 19:22:05.054151 76463 notify.go:220] Checking for updates...
I1219 19:22:05.055645 76463 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1219 19:22:05.057702 76463 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17837-52368/kubeconfig
I1219 19:22:05.059211 76463 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17837-52368/.minikube
I1219 19:22:05.060734 76463 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I1219 19:22:05.062211 76463 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1219 19:22:05.064150 76463 config.go:182] Loaded profile config "kubernetes-upgrade-518545": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I1219 19:22:05.064835 76463 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2
I1219 19:22:05.064891 76463 main.go:141] libmachine: Launching plugin server for driver kvm2
I1219 19:22:05.083982 76463 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43895
I1219 19:22:05.084663 76463 main.go:141] libmachine: () Calling .GetVersion
I1219 19:22:05.085312 76463 main.go:141] libmachine: Using API Version 1
I1219 19:22:05.085336 76463 main.go:141] libmachine: () Calling .SetConfigRaw
I1219 19:22:05.085737 76463 main.go:141] libmachine: () Calling .GetMachineName
I1219 19:22:05.085901 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .DriverName
I1219 19:22:05.086199 76463 driver.go:392] Setting default libvirt URI to qemu:///system
I1219 19:22:05.086610 76463 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2
I1219 19:22:05.086641 76463 main.go:141] libmachine: Launching plugin server for driver kvm2
I1219 19:22:05.106342 76463 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37429
I1219 19:22:05.106948 76463 main.go:141] libmachine: () Calling .GetVersion
I1219 19:22:05.107674 76463 main.go:141] libmachine: Using API Version 1
I1219 19:22:05.107712 76463 main.go:141] libmachine: () Calling .SetConfigRaw
I1219 19:22:05.108065 76463 main.go:141] libmachine: () Calling .GetMachineName
I1219 19:22:05.108321 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .DriverName
I1219 19:22:05.160387 76463 out.go:177] * Using the kvm2 driver based on existing profile
I1219 19:22:05.161749 76463 start.go:298] selected driver: kvm2
I1219 19:22:05.161769 76463 start.go:902] validating driver "kvm2" against &{Name:kubernetes-upgrade-518545 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17806/minikube-v1.32.1-1702708929-17806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1702920864-17822@sha256:4842b362f06b33d847d73f7ed166c93ce608f4c4cea49b711c7055fd50ebd1e0 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-518545 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.61.61 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262
144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1219 19:22:05.161948 76463 start.go:913] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1219 19:22:05.162945 76463 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1219 19:22:05.163046 76463 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17837-52368/.minikube/bin:/home/jenkins/workspace/KVM_Linux_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I1219 19:22:05.183000 76463 install.go:137] /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I1219 19:22:05.183553 76463 cni.go:84] Creating CNI manager for ""
I1219 19:22:05.183585 76463 cni.go:158] "kvm2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1219 19:22:05.183600 76463 start_flags.go:323] config:
{Name:kubernetes-upgrade-518545 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17806/minikube-v1.32.1-1702708929-17806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1702920864-17822@sha256:4842b362f06b33d847d73f7ed166c93ce608f4c4cea49b711c7055fd50ebd1e0 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:kubernetes-upgrade-518545
Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.61.61 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror
: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1219 19:22:05.183829 76463 iso.go:125] acquiring lock: {Name:mkf95fc4b74151141e887f8ce75151fead45b45e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1219 19:22:05.185846 76463 out.go:177] * Starting control plane node kubernetes-upgrade-518545 in cluster kubernetes-upgrade-518545
I1219 19:22:05.187212 76463 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
I1219 19:22:05.187272 76463 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17837-52368/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
I1219 19:22:05.187286 76463 cache.go:56] Caching tarball of preloaded images
I1219 19:22:05.187385 76463 preload.go:174] Found /home/jenkins/minikube-integration/17837-52368/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I1219 19:22:05.187401 76463 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
I1219 19:22:05.187539 76463 profile.go:148] Saving config to /home/jenkins/minikube-integration/17837-52368/.minikube/profiles/kubernetes-upgrade-518545/config.json ...
I1219 19:22:05.187773 76463 start.go:365] acquiring machines lock for kubernetes-upgrade-518545: {Name:mk5badd06978535f186731b9c2527f87282ec762 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1219 19:22:05.187816 76463 start.go:369] acquired machines lock for "kubernetes-upgrade-518545" in 23.776µs
I1219 19:22:05.187831 76463 start.go:96] Skipping create...Using existing machine configuration
I1219 19:22:05.187837 76463 fix.go:54] fixHost starting:
I1219 19:22:05.188218 76463 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2
I1219 19:22:05.188251 76463 main.go:141] libmachine: Launching plugin server for driver kvm2
I1219 19:22:05.206998 76463 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38207
I1219 19:22:05.207507 76463 main.go:141] libmachine: () Calling .GetVersion
I1219 19:22:05.208039 76463 main.go:141] libmachine: Using API Version 1
I1219 19:22:05.208063 76463 main.go:141] libmachine: () Calling .SetConfigRaw
I1219 19:22:05.208443 76463 main.go:141] libmachine: () Calling .GetMachineName
I1219 19:22:05.208627 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .DriverName
I1219 19:22:05.208758 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetState
I1219 19:22:05.210461 76463 fix.go:102] recreateIfNeeded on kubernetes-upgrade-518545: state=Stopped err=<nil>
I1219 19:22:05.210488 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .DriverName
W1219 19:22:05.210667 76463 fix.go:128] unexpected machine state, will restart: <nil>
I1219 19:22:05.212954 76463 out.go:177] * Restarting existing kvm2 VM for "kubernetes-upgrade-518545" ...
I1219 19:22:05.214430 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .Start
I1219 19:22:05.214619 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Ensuring networks are active...
I1219 19:22:05.215597 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Ensuring network default is active
I1219 19:22:05.216129 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Ensuring network mk-kubernetes-upgrade-518545 is active
I1219 19:22:05.216766 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Getting domain xml...
I1219 19:22:05.217701 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Creating domain...
I1219 19:22:06.819717 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Waiting to get IP...
I1219 19:22:06.820897 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:06.821391 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | unable to find current IP address of domain kubernetes-upgrade-518545 in network mk-kubernetes-upgrade-518545
I1219 19:22:06.821459 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | I1219 19:22:06.821362 76497 retry.go:31] will retry after 291.982812ms: waiting for machine to come up
I1219 19:22:07.115137 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:07.115634 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | unable to find current IP address of domain kubernetes-upgrade-518545 in network mk-kubernetes-upgrade-518545
I1219 19:22:07.115670 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | I1219 19:22:07.115574 76497 retry.go:31] will retry after 269.771181ms: waiting for machine to come up
I1219 19:22:07.387178 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:07.387680 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | unable to find current IP address of domain kubernetes-upgrade-518545 in network mk-kubernetes-upgrade-518545
I1219 19:22:07.387713 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | I1219 19:22:07.387635 76497 retry.go:31] will retry after 335.788646ms: waiting for machine to come up
I1219 19:22:07.725137 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:07.725668 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | unable to find current IP address of domain kubernetes-upgrade-518545 in network mk-kubernetes-upgrade-518545
I1219 19:22:07.725702 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | I1219 19:22:07.725615 76497 retry.go:31] will retry after 576.174148ms: waiting for machine to come up
I1219 19:22:08.303481 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:08.303990 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | unable to find current IP address of domain kubernetes-upgrade-518545 in network mk-kubernetes-upgrade-518545
I1219 19:22:08.304021 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | I1219 19:22:08.303934 76497 retry.go:31] will retry after 595.734989ms: waiting for machine to come up
I1219 19:22:08.901893 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:08.902356 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | unable to find current IP address of domain kubernetes-upgrade-518545 in network mk-kubernetes-upgrade-518545
I1219 19:22:08.902381 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | I1219 19:22:08.902279 76497 retry.go:31] will retry after 632.4492ms: waiting for machine to come up
I1219 19:22:09.535889 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:09.536352 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | unable to find current IP address of domain kubernetes-upgrade-518545 in network mk-kubernetes-upgrade-518545
I1219 19:22:09.536388 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | I1219 19:22:09.536295 76497 retry.go:31] will retry after 812.285891ms: waiting for machine to come up
I1219 19:22:10.350145 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:10.350676 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | unable to find current IP address of domain kubernetes-upgrade-518545 in network mk-kubernetes-upgrade-518545
I1219 19:22:10.350705 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | I1219 19:22:10.350614 76497 retry.go:31] will retry after 1.411071635s: waiting for machine to come up
I1219 19:22:11.764132 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:11.764573 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | unable to find current IP address of domain kubernetes-upgrade-518545 in network mk-kubernetes-upgrade-518545
I1219 19:22:11.764603 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | I1219 19:22:11.764521 76497 retry.go:31] will retry after 1.42821257s: waiting for machine to come up
I1219 19:22:13.194111 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:13.194495 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | unable to find current IP address of domain kubernetes-upgrade-518545 in network mk-kubernetes-upgrade-518545
I1219 19:22:13.194520 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | I1219 19:22:13.194448 76497 retry.go:31] will retry after 2.30130284s: waiting for machine to come up
I1219 19:22:15.497636 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:15.498160 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | unable to find current IP address of domain kubernetes-upgrade-518545 in network mk-kubernetes-upgrade-518545
I1219 19:22:15.498191 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | I1219 19:22:15.498096 76497 retry.go:31] will retry after 2.778698473s: waiting for machine to come up
I1219 19:22:18.278430 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:18.279021 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | unable to find current IP address of domain kubernetes-upgrade-518545 in network mk-kubernetes-upgrade-518545
I1219 19:22:18.279047 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | I1219 19:22:18.278952 76497 retry.go:31] will retry after 2.93042701s: waiting for machine to come up
I1219 19:22:21.211141 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:21.211505 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | unable to find current IP address of domain kubernetes-upgrade-518545 in network mk-kubernetes-upgrade-518545
I1219 19:22:21.211549 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | I1219 19:22:21.211448 76497 retry.go:31] will retry after 3.59087503s: waiting for machine to come up
I1219 19:22:24.806018 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:24.806551 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has current primary IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:24.806585 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Found IP for machine: 192.168.61.61
I1219 19:22:24.806600 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Reserving static IP address...
I1219 19:22:24.807032 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "kubernetes-upgrade-518545", mac: "52:54:00:45:62:84", ip: "192.168.61.61"} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:24.807072 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | skip adding static IP to network mk-kubernetes-upgrade-518545 - found existing host DHCP lease matching {name: "kubernetes-upgrade-518545", mac: "52:54:00:45:62:84", ip: "192.168.61.61"}
I1219 19:22:24.807094 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Reserved static IP address: 192.168.61.61
I1219 19:22:24.807113 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Waiting for SSH to be available...
I1219 19:22:24.807129 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | Getting to WaitForSSH function...
I1219 19:22:24.809325 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:24.809760 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:24.809793 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:24.809885 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | Using SSH client type: external
I1219 19:22:24.809937 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | Using SSH private key: /home/jenkins/minikube-integration/17837-52368/.minikube/machines/kubernetes-upgrade-518545/id_rsa (-rw-------)
I1219 19:22:24.809967 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.61 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17837-52368/.minikube/machines/kubernetes-upgrade-518545/id_rsa -p 22] /usr/bin/ssh <nil>}
I1219 19:22:24.809979 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | About to run SSH command:
I1219 19:22:24.809998 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | exit 0
I1219 19:22:24.906031 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | SSH cmd err, output: <nil>:
I1219 19:22:24.906433 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetConfigRaw
I1219 19:22:24.907190 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetIP
I1219 19:22:24.910423 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:24.910819 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:24.910846 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:24.911310 76463 profile.go:148] Saving config to /home/jenkins/minikube-integration/17837-52368/.minikube/profiles/kubernetes-upgrade-518545/config.json ...
I1219 19:22:24.911571 76463 machine.go:88] provisioning docker machine ...
I1219 19:22:24.911603 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .DriverName
I1219 19:22:24.911820 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetMachineName
I1219 19:22:24.912040 76463 buildroot.go:166] provisioning hostname "kubernetes-upgrade-518545"
I1219 19:22:24.912065 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetMachineName
I1219 19:22:24.912261 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHHostname
I1219 19:22:24.915107 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:24.915439 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:24.915480 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:24.915632 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHPort
I1219 19:22:24.915829 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:24.915961 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:24.916114 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHUsername
I1219 19:22:24.916382 76463 main.go:141] libmachine: Using SSH client type: native
I1219 19:22:24.916929 76463 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x809380] 0x80c060 <nil> [] 0s} 192.168.61.61 22 <nil> <nil>}
I1219 19:22:24.916955 76463 main.go:141] libmachine: About to run SSH command:
sudo hostname kubernetes-upgrade-518545 && echo "kubernetes-upgrade-518545" | sudo tee /etc/hostname
I1219 19:22:25.078849 76463 main.go:141] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-518545
I1219 19:22:25.078903 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHHostname
I1219 19:22:25.082819 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:25.083271 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:25.083376 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:25.083650 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHPort
I1219 19:22:25.083883 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:25.084114 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:25.084330 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHUsername
I1219 19:22:25.084533 76463 main.go:141] libmachine: Using SSH client type: native
I1219 19:22:25.084873 76463 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x809380] 0x80c060 <nil> [] 0s} 192.168.61.61 22 <nil> <nil>}
I1219 19:22:25.084899 76463 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\skubernetes-upgrade-518545' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kubernetes-upgrade-518545/g' /etc/hosts;
else
echo '127.0.1.1 kubernetes-upgrade-518545' | sudo tee -a /etc/hosts;
fi
fi
I1219 19:22:25.240799 76463 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1219 19:22:25.240828 76463 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17837-52368/.minikube CaCertPath:/home/jenkins/minikube-integration/17837-52368/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17837-52368/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17837-52368/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17837-52368/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17837-52368/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17837-52368/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17837-52368/.minikube}
I1219 19:22:25.240847 76463 buildroot.go:174] setting up certificates
I1219 19:22:25.240872 76463 provision.go:83] configureAuth start
I1219 19:22:25.240892 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetMachineName
I1219 19:22:25.241212 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetIP
I1219 19:22:25.244459 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:25.244843 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:25.244869 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:25.244996 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHHostname
I1219 19:22:25.247753 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:25.248463 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:25.248499 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:25.248591 76463 provision.go:138] copyHostCerts
I1219 19:22:25.248655 76463 exec_runner.go:144] found /home/jenkins/minikube-integration/17837-52368/.minikube/ca.pem, removing ...
I1219 19:22:25.248673 76463 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17837-52368/.minikube/ca.pem
I1219 19:22:25.248741 76463 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17837-52368/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17837-52368/.minikube/ca.pem (1078 bytes)
I1219 19:22:25.248861 76463 exec_runner.go:144] found /home/jenkins/minikube-integration/17837-52368/.minikube/cert.pem, removing ...
I1219 19:22:25.248873 76463 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17837-52368/.minikube/cert.pem
I1219 19:22:25.248900 76463 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17837-52368/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17837-52368/.minikube/cert.pem (1123 bytes)
I1219 19:22:25.249057 76463 exec_runner.go:144] found /home/jenkins/minikube-integration/17837-52368/.minikube/key.pem, removing ...
I1219 19:22:25.249069 76463 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17837-52368/.minikube/key.pem
I1219 19:22:25.249114 76463 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17837-52368/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17837-52368/.minikube/key.pem (1679 bytes)
I1219 19:22:25.249194 76463 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17837-52368/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17837-52368/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17837-52368/.minikube/certs/ca-key.pem org=jenkins.kubernetes-upgrade-518545 san=[192.168.61.61 192.168.61.61 localhost 127.0.0.1 minikube kubernetes-upgrade-518545]
I1219 19:22:25.698844 76463 provision.go:172] copyRemoteCerts
I1219 19:22:25.698916 76463 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1219 19:22:25.698949 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHHostname
I1219 19:22:25.701685 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:25.702052 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:25.702086 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:25.702274 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHPort
I1219 19:22:25.702479 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:25.702655 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHUsername
I1219 19:22:25.702838 76463 sshutil.go:53] new ssh client: &{IP:192.168.61.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17837-52368/.minikube/machines/kubernetes-upgrade-518545/id_rsa Username:docker}
I1219 19:22:25.803082 76463 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17837-52368/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1219 19:22:25.828957 76463 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17837-52368/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I1219 19:22:25.854588 76463 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17837-52368/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1219 19:22:25.880043 76463 provision.go:86] duration metric: configureAuth took 639.145762ms
I1219 19:22:25.880076 76463 buildroot.go:189] setting minikube options for container-runtime
I1219 19:22:25.880322 76463 config.go:182] Loaded profile config "kubernetes-upgrade-518545": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
I1219 19:22:25.880358 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .DriverName
I1219 19:22:25.880660 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHHostname
I1219 19:22:25.883841 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:25.884273 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:25.884314 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:25.884528 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHPort
I1219 19:22:25.884747 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:25.884929 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:25.885129 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHUsername
I1219 19:22:25.885371 76463 main.go:141] libmachine: Using SSH client type: native
I1219 19:22:25.885769 76463 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x809380] 0x80c060 <nil> [] 0s} 192.168.61.61 22 <nil> <nil>}
I1219 19:22:25.885783 76463 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I1219 19:22:26.024340 76463 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I1219 19:22:26.024367 76463 buildroot.go:70] root file system type: tmpfs
I1219 19:22:26.024524 76463 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I1219 19:22:26.024558 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHHostname
I1219 19:22:26.028199 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:26.028663 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:26.028701 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:26.028818 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHPort
I1219 19:22:26.029001 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:26.029224 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:26.029391 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHUsername
I1219 19:22:26.029646 76463 main.go:141] libmachine: Using SSH client type: native
I1219 19:22:26.030205 76463 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x809380] 0x80c060 <nil> [] 0s} 192.168.61.61 22 <nil> <nil>}
I1219 19:22:26.030320 76463 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I1219 19:22:26.184916 76463 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I1219 19:22:26.184969 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHHostname
I1219 19:22:26.188044 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:26.188388 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:26.188423 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:26.188745 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHPort
I1219 19:22:26.188942 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:26.189214 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:26.189470 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHUsername
I1219 19:22:26.189675 76463 main.go:141] libmachine: Using SSH client type: native
I1219 19:22:26.190034 76463 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x809380] 0x80c060 <nil> [] 0s} 192.168.61.61 22 <nil> <nil>}
I1219 19:22:26.190069 76463 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I1219 19:22:27.284628 76463 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I1219 19:22:27.284662 76463 machine.go:91] provisioned docker machine in 2.373073331s
I1219 19:22:27.284676 76463 start.go:300] post-start starting for "kubernetes-upgrade-518545" (driver="kvm2")
I1219 19:22:27.284687 76463 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1219 19:22:27.284703 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .DriverName
I1219 19:22:27.285031 76463 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1219 19:22:27.285080 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHHostname
I1219 19:22:27.287790 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:27.288164 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:27.288196 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:27.288283 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHPort
I1219 19:22:27.288499 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:27.288656 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHUsername
I1219 19:22:27.288833 76463 sshutil.go:53] new ssh client: &{IP:192.168.61.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17837-52368/.minikube/machines/kubernetes-upgrade-518545/id_rsa Username:docker}
I1219 19:22:27.387801 76463 ssh_runner.go:195] Run: cat /etc/os-release
I1219 19:22:27.392373 76463 info.go:137] Remote host: Buildroot 2021.02.12
I1219 19:22:27.392404 76463 filesync.go:126] Scanning /home/jenkins/minikube-integration/17837-52368/.minikube/addons for local assets ...
I1219 19:22:27.392478 76463 filesync.go:126] Scanning /home/jenkins/minikube-integration/17837-52368/.minikube/files for local assets ...
I1219 19:22:27.392567 76463 filesync.go:149] local asset: /home/jenkins/minikube-integration/17837-52368/.minikube/files/etc/ssl/certs/594212.pem -> 594212.pem in /etc/ssl/certs
I1219 19:22:27.392653 76463 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1219 19:22:27.401405 76463 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17837-52368/.minikube/files/etc/ssl/certs/594212.pem --> /etc/ssl/certs/594212.pem (1708 bytes)
I1219 19:22:27.427317 76463 start.go:303] post-start completed in 142.625862ms
I1219 19:22:27.427345 76463 fix.go:56] fixHost completed within 22.239506735s
I1219 19:22:27.427371 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHHostname
I1219 19:22:27.430016 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:27.430378 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:27.430407 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:27.430591 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHPort
I1219 19:22:27.430789 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:27.430972 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:27.431123 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHUsername
I1219 19:22:27.431293 76463 main.go:141] libmachine: Using SSH client type: native
I1219 19:22:27.431750 76463 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x809380] 0x80c060 <nil> [] 0s} 192.168.61.61 22 <nil> <nil>}
I1219 19:22:27.431772 76463 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I1219 19:22:27.565894 76463 main.go:141] libmachine: SSH cmd err, output: <nil>: 1703013747.512031591
I1219 19:22:27.565918 76463 fix.go:206] guest clock: 1703013747.512031591
I1219 19:22:27.565925 76463 fix.go:219] Guest: 2023-12-19 19:22:27.512031591 +0000 UTC Remote: 2023-12-19 19:22:27.427349979 +0000 UTC m=+22.454688520 (delta=84.681612ms)
I1219 19:22:27.565943 76463 fix.go:190] guest clock delta is within tolerance: 84.681612ms
I1219 19:22:27.565948 76463 start.go:83] releasing machines lock for "kubernetes-upgrade-518545", held for 22.378124921s
I1219 19:22:27.565980 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .DriverName
I1219 19:22:27.566293 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetIP
I1219 19:22:27.569490 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:27.569899 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:27.569943 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:27.570112 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .DriverName
I1219 19:22:27.570713 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .DriverName
I1219 19:22:27.570925 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .DriverName
I1219 19:22:27.571023 76463 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1219 19:22:27.571074 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHHostname
I1219 19:22:27.571172 76463 ssh_runner.go:195] Run: cat /version.json
I1219 19:22:27.571200 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHHostname
I1219 19:22:27.573846 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:27.573889 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:27.574221 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:27.574260 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:62:84", ip: ""} in network mk-kubernetes-upgrade-518545: {Iface:virbr3 ExpiryTime:2023-12-19 20:22:19 +0000 UTC Type:0 Mac:52:54:00:45:62:84 Iaid: IPaddr:192.168.61.61 Prefix:24 Hostname:kubernetes-upgrade-518545 Clientid:01:52:54:00:45:62:84}
I1219 19:22:27.574292 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:27.574314 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) DBG | domain kubernetes-upgrade-518545 has defined IP address 192.168.61.61 and MAC address 52:54:00:45:62:84 in network mk-kubernetes-upgrade-518545
I1219 19:22:27.574452 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHPort
I1219 19:22:27.574536 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHPort
I1219 19:22:27.574706 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:27.574747 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHKeyPath
I1219 19:22:27.574831 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHUsername
I1219 19:22:27.574880 76463 main.go:141] libmachine: (kubernetes-upgrade-518545) Calling .GetSSHUsername
I1219 19:22:27.574998 76463 sshutil.go:53] new ssh client: &{IP:192.168.61.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17837-52368/.minikube/machines/kubernetes-upgrade-518545/id_rsa Username:docker}
I1219 19:22:27.575070 76463 sshutil.go:53] new ssh client: &{IP:192.168.61.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17837-52368/.minikube/machines/kubernetes-upgrade-518545/id_rsa Username:docker}
I1219 19:22:27.693838 76463 ssh_runner.go:195] Run: systemctl --version
I1219 19:22:27.700758 76463 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1219 19:22:27.708016 76463 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1219 19:22:27.708082 76463 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
I1219 19:22:27.718965 76463 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
I1219 19:22:27.735666 76463 cni.go:308] configured [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1219 19:22:27.735699 76463 start.go:475] detecting cgroup driver to use...
I1219 19:22:27.735857 76463 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1219 19:22:27.758710 76463 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I1219 19:22:27.772532 76463 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1219 19:22:27.785262 76463 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I1219 19:22:27.785347 76463 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1219 19:22:27.797081 76463 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1219 19:22:27.809730 76463 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1219 19:22:27.822494 76463 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1219 19:22:27.835470 76463 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1219 19:22:27.850334 76463 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1219 19:22:27.871147 76463 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1219 19:22:27.883456 76463 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1219 19:22:27.895475 76463 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1219 19:22:28.050117 76463 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1219 19:22:28.069908 76463 start.go:475] detecting cgroup driver to use...
I1219 19:22:28.070010 76463 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I1219 19:22:28.091675 76463 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1219 19:22:28.110397 76463 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1219 19:22:28.133008 76463 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1219 19:22:28.148798 76463 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1219 19:22:28.163572 76463 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1219 19:22:28.192422 76463 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1219 19:22:28.208296 76463 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I1219 19:22:28.228024 76463 ssh_runner.go:195] Run: which cri-dockerd
I1219 19:22:28.233883 76463 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I1219 19:22:28.244918 76463 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I1219 19:22:28.263323 76463 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I1219 19:22:28.388219 76463 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I1219 19:22:28.517762 76463 docker.go:560] configuring docker to use "cgroupfs" as cgroup driver...
I1219 19:22:28.517939 76463 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I1219 19:22:28.537320 76463 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1219 19:22:28.663505 76463 ssh_runner.go:195] Run: sudo systemctl restart docker
I1219 19:22:30.219117 76463 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.555573874s)
I1219 19:22:30.219220 76463 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I1219 19:22:30.352817 76463 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I1219 19:22:30.498425 76463 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I1219 19:22:30.644708 76463 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1219 19:22:30.792032 76463 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I1219 19:22:30.816427 76463 ssh_runner.go:195] Run: sudo journalctl --no-pager -u cri-docker.socket
I1219 19:22:30.956684 76463 out.go:177]
W1219 19:22:30.958901 76463 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart cri-docker.socket: Process exited with status 1
stdout:
stderr:
Job failed. See "journalctl -xe" for details.
sudo journalctl --no-pager -u cri-docker.socket:
-- stdout --
-- Journal begins at Tue 2023-12-19 19:22:18 UTC, ends at Tue 2023-12-19 19:22:30 UTC. --
Dec 19 19:22:19 minikube systemd[1]: Starting CRI Docker Socket for the API.
Dec 19 19:22:19 minikube systemd[1]: Listening on CRI Docker Socket for the API.
Dec 19 19:22:22 minikube systemd[1]: cri-docker.socket: Succeeded.
Dec 19 19:22:22 minikube systemd[1]: Closed CRI Docker Socket for the API.
Dec 19 19:22:22 minikube systemd[1]: Stopping CRI Docker Socket for the API.
Dec 19 19:22:22 minikube systemd[1]: Starting CRI Docker Socket for the API.
Dec 19 19:22:22 minikube systemd[1]: Listening on CRI Docker Socket for the API.
Dec 19 19:22:24 minikube systemd[1]: cri-docker.socket: Succeeded.
Dec 19 19:22:24 minikube systemd[1]: Closed CRI Docker Socket for the API.
Dec 19 19:22:24 minikube systemd[1]: Stopping CRI Docker Socket for the API.
Dec 19 19:22:24 minikube systemd[1]: Starting CRI Docker Socket for the API.
Dec 19 19:22:24 minikube systemd[1]: Listening on CRI Docker Socket for the API.
Dec 19 19:22:26 kubernetes-upgrade-518545 systemd[1]: cri-docker.socket: Succeeded.
Dec 19 19:22:26 kubernetes-upgrade-518545 systemd[1]: Closed CRI Docker Socket for the API.
Dec 19 19:22:26 kubernetes-upgrade-518545 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 19 19:22:26 kubernetes-upgrade-518545 systemd[1]: Starting CRI Docker Socket for the API.
Dec 19 19:22:26 kubernetes-upgrade-518545 systemd[1]: Listening on CRI Docker Socket for the API.
Dec 19 19:22:28 kubernetes-upgrade-518545 systemd[1]: cri-docker.socket: Succeeded.
Dec 19 19:22:28 kubernetes-upgrade-518545 systemd[1]: Closed CRI Docker Socket for the API.
Dec 19 19:22:28 kubernetes-upgrade-518545 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 19 19:22:28 kubernetes-upgrade-518545 systemd[1]: Starting CRI Docker Socket for the API.
Dec 19 19:22:28 kubernetes-upgrade-518545 systemd[1]: Listening on CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: cri-docker.socket: Succeeded.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Closed CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Starting CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Listening on CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: cri-docker.socket: Succeeded.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Closed CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: cri-docker.socket: Socket service cri-docker.service already active, refusing.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Failed to listen on CRI Docker Socket for the API.
-- /stdout --
X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart cri-docker.socket: Process exited with status 1
stdout:
stderr:
Job failed. See "journalctl -xe" for details.
sudo journalctl --no-pager -u cri-docker.socket:
-- stdout --
-- Journal begins at Tue 2023-12-19 19:22:18 UTC, ends at Tue 2023-12-19 19:22:30 UTC. --
Dec 19 19:22:19 minikube systemd[1]: Starting CRI Docker Socket for the API.
Dec 19 19:22:19 minikube systemd[1]: Listening on CRI Docker Socket for the API.
Dec 19 19:22:22 minikube systemd[1]: cri-docker.socket: Succeeded.
Dec 19 19:22:22 minikube systemd[1]: Closed CRI Docker Socket for the API.
Dec 19 19:22:22 minikube systemd[1]: Stopping CRI Docker Socket for the API.
Dec 19 19:22:22 minikube systemd[1]: Starting CRI Docker Socket for the API.
Dec 19 19:22:22 minikube systemd[1]: Listening on CRI Docker Socket for the API.
Dec 19 19:22:24 minikube systemd[1]: cri-docker.socket: Succeeded.
Dec 19 19:22:24 minikube systemd[1]: Closed CRI Docker Socket for the API.
Dec 19 19:22:24 minikube systemd[1]: Stopping CRI Docker Socket for the API.
Dec 19 19:22:24 minikube systemd[1]: Starting CRI Docker Socket for the API.
Dec 19 19:22:24 minikube systemd[1]: Listening on CRI Docker Socket for the API.
Dec 19 19:22:26 kubernetes-upgrade-518545 systemd[1]: cri-docker.socket: Succeeded.
Dec 19 19:22:26 kubernetes-upgrade-518545 systemd[1]: Closed CRI Docker Socket for the API.
Dec 19 19:22:26 kubernetes-upgrade-518545 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 19 19:22:26 kubernetes-upgrade-518545 systemd[1]: Starting CRI Docker Socket for the API.
Dec 19 19:22:26 kubernetes-upgrade-518545 systemd[1]: Listening on CRI Docker Socket for the API.
Dec 19 19:22:28 kubernetes-upgrade-518545 systemd[1]: cri-docker.socket: Succeeded.
Dec 19 19:22:28 kubernetes-upgrade-518545 systemd[1]: Closed CRI Docker Socket for the API.
Dec 19 19:22:28 kubernetes-upgrade-518545 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 19 19:22:28 kubernetes-upgrade-518545 systemd[1]: Starting CRI Docker Socket for the API.
Dec 19 19:22:28 kubernetes-upgrade-518545 systemd[1]: Listening on CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: cri-docker.socket: Succeeded.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Closed CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Starting CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Listening on CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: cri-docker.socket: Succeeded.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Closed CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: cri-docker.socket: Socket service cri-docker.service already active, refusing.
Dec 19 19:22:30 kubernetes-upgrade-518545 systemd[1]: Failed to listen on CRI Docker Socket for the API.
-- /stdout --
W1219 19:22:30.958980 76463 out.go:239] *
*
W1219 19:22:30.960151 76463 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1219 19:22:30.962648 76463 out.go:177]
** /stderr **
version_upgrade_test.go:258: failed to upgrade with newest k8s version. args: out/minikube-linux-amd64 start -p kubernetes-upgrade-518545 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=kvm2 : exit status 90
version_upgrade_test.go:261: (dbg) Run: kubectl --context kubernetes-upgrade-518545 version --output=json
version_upgrade_test.go:261: (dbg) Non-zero exit: kubectl --context kubernetes-upgrade-518545 version --output=json: exit status 1 (62.130519ms)
** stderr **
error: context "kubernetes-upgrade-518545" does not exist
** /stderr **
version_upgrade_test.go:263: error running kubectl: exit status 1
panic.go:523: *** TestKubernetesUpgrade FAILED at 2023-12-19 19:22:31.091611012 +0000 UTC m=+2310.604290097
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p kubernetes-upgrade-518545 -n kubernetes-upgrade-518545
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p kubernetes-upgrade-518545 -n kubernetes-upgrade-518545: exit status 6 (285.399784ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E1219 19:22:31.354414 76840 status.go:415] kubeconfig endpoint: extract IP: "kubernetes-upgrade-518545" does not appear in /home/jenkins/minikube-integration/17837-52368/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "kubernetes-upgrade-518545" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
helpers_test.go:175: Cleaning up "kubernetes-upgrade-518545" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p kubernetes-upgrade-518545
--- FAIL: TestKubernetesUpgrade (128.91s)