0194cc3582ecd25a736ac3660bc9effa677f982b:2022-11-02:26370
| Order | failed test | Duration |
|---|---|---|
| 201 | TestPreload | 173.71 |
| 226 | TestStoppedBinaryUpgrade/Upgrade | 1544.15 |
=== RUN TestPreload
preload_test.go:44: (dbg) Run: out/minikube-linux-amd64 start -p test-preload-232607 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.24.4
E1101 23:26:28.341609 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:27:48.193469 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
preload_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-232607 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.24.4: (1m57.511268029s)
preload_test.go:57: (dbg) Run: out/minikube-linux-amd64 ssh -p test-preload-232607 -- sudo crictl pull gcr.io/k8s-minikube/busybox
preload_test.go:57: (dbg) Done: out/minikube-linux-amd64 ssh -p test-preload-232607 -- sudo crictl pull gcr.io/k8s-minikube/busybox: (2.357675375s)
preload_test.go:67: (dbg) Run: out/minikube-linux-amd64 start -p test-preload-232607 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.24.6
preload_test.go:67: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-232607 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.24.6: (50.577659895s)
preload_test.go:76: (dbg) Run: out/minikube-linux-amd64 ssh -p test-preload-232607 -- sudo crictl image ls
preload_test.go:81: Expected to find gcr.io/k8s-minikube/busybox in output of `docker images`, instead got
-- stdout --
IMAGE TAG IMAGE ID SIZE
docker.io/kindest/kindnetd v20220726-ed811e41 d921cee849482 25.8MB
gcr.io/k8s-minikube/storage-provisioner v5 6e38f40d628db 9.06MB
k8s.gcr.io/coredns/coredns v1.8.6 a4ca41631cc7a 13.6MB
k8s.gcr.io/etcd 3.5.3-0 aebe758cef4cd 102MB
k8s.gcr.io/kube-apiserver v1.24.6 860f263331c95 33.8MB
k8s.gcr.io/kube-controller-manager v1.24.6 c6c20157a4233 31MB
k8s.gcr.io/kube-proxy v1.24.4 7a53d1e08ef58 39.5MB
k8s.gcr.io/kube-proxy v1.24.6 0bb39497ab33b 39.5MB
k8s.gcr.io/kube-scheduler v1.24.6 c786c777a4e1c 15.5MB
k8s.gcr.io/pause 3.7 221177c6082a8 311kB
-- /stdout --
panic.go:522: *** TestPreload FAILED at 2022-11-01 23:28:57.980196025 +0000 UTC m=+2623.844744476
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p test-preload-232607 -n test-preload-232607
helpers_test.go:244: <<< TestPreload FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestPreload]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p test-preload-232607 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p test-preload-232607 logs -n 25: (1.105386431s)
helpers_test.go:252: TestPreload logs:
-- stdout --
*
* ==> Audit <==
* |---------|-----------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|-----------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| cp | multinode-230419 cp multinode-230419-m03:/home/docker/cp-test.txt | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:08 UTC | 01 Nov 22 23:08 UTC |
| | multinode-230419:/home/docker/cp-test_multinode-230419-m03_multinode-230419.txt | | | | | |
| ssh | multinode-230419 ssh -n | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:08 UTC | 01 Nov 22 23:08 UTC |
| | multinode-230419-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-230419 ssh -n multinode-230419 sudo cat | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:08 UTC | 01 Nov 22 23:08 UTC |
| | /home/docker/cp-test_multinode-230419-m03_multinode-230419.txt | | | | | |
| cp | multinode-230419 cp multinode-230419-m03:/home/docker/cp-test.txt | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:08 UTC | 01 Nov 22 23:08 UTC |
| | multinode-230419-m02:/home/docker/cp-test_multinode-230419-m03_multinode-230419-m02.txt | | | | | |
| ssh | multinode-230419 ssh -n | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:08 UTC | 01 Nov 22 23:08 UTC |
| | multinode-230419-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-230419 ssh -n multinode-230419-m02 sudo cat | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:08 UTC | 01 Nov 22 23:08 UTC |
| | /home/docker/cp-test_multinode-230419-m03_multinode-230419-m02.txt | | | | | |
| node | multinode-230419 node stop m03 | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:08 UTC | 01 Nov 22 23:08 UTC |
| node | multinode-230419 node start | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:08 UTC | 01 Nov 22 23:08 UTC |
| | m03 --alsologtostderr | | | | | |
| node | list -p multinode-230419 | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:08 UTC | |
| stop | -p multinode-230419 | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:08 UTC | 01 Nov 22 23:11 UTC |
| start | -p multinode-230419 | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:11 UTC | 01 Nov 22 23:18 UTC |
| | --wait=true -v=8 | | | | | |
| | --alsologtostderr | | | | | |
| node | list -p multinode-230419 | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:18 UTC | |
| node | multinode-230419 node delete | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:18 UTC | 01 Nov 22 23:18 UTC |
| | m03 | | | | | |
| stop | multinode-230419 stop | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:18 UTC | 01 Nov 22 23:21 UTC |
| start | -p multinode-230419 | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:21 UTC | 01 Nov 22 23:25 UTC |
| | --wait=true -v=8 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=containerd | | | | | |
| node | list -p multinode-230419 | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:25 UTC | |
| start | -p multinode-230419-m02 | multinode-230419-m02 | jenkins | v1.27.1 | 01 Nov 22 23:25 UTC | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=containerd | | | | | |
| start | -p multinode-230419-m03 | multinode-230419-m03 | jenkins | v1.27.1 | 01 Nov 22 23:25 UTC | 01 Nov 22 23:26 UTC |
| | --driver=kvm2 | | | | | |
| | --container-runtime=containerd | | | | | |
| node | add -p multinode-230419 | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:26 UTC | |
| delete | -p multinode-230419-m03 | multinode-230419-m03 | jenkins | v1.27.1 | 01 Nov 22 23:26 UTC | 01 Nov 22 23:26 UTC |
| delete | -p multinode-230419 | multinode-230419 | jenkins | v1.27.1 | 01 Nov 22 23:26 UTC | 01 Nov 22 23:26 UTC |
| start | -p test-preload-232607 | test-preload-232607 | jenkins | v1.27.1 | 01 Nov 22 23:26 UTC | 01 Nov 22 23:28 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=kvm2 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.24.4 | | | | | |
| ssh | -p test-preload-232607 | test-preload-232607 | jenkins | v1.27.1 | 01 Nov 22 23:28 UTC | 01 Nov 22 23:28 UTC |
| | -- sudo crictl pull | | | | | |
| | gcr.io/k8s-minikube/busybox | | | | | |
| start | -p test-preload-232607 | test-preload-232607 | jenkins | v1.27.1 | 01 Nov 22 23:28 UTC | 01 Nov 22 23:28 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| | --wait=true --driver=kvm2 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.24.6 | | | | | |
| ssh | -p test-preload-232607 -- sudo | test-preload-232607 | jenkins | v1.27.1 | 01 Nov 22 23:28 UTC | 01 Nov 22 23:28 UTC |
| | crictl image ls | | | | | |
|---------|-----------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
*
* ==> Last Start <==
* Log file created at: 2022/11/01 23:28:07
Running on machine: ubuntu-20-agent-5
Binary: Built with gc go1.19.2 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1101 23:28:07.212406 24185 out.go:296] Setting OutFile to fd 1 ...
I1101 23:28:07.212517 24185 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 23:28:07.212527 24185 out.go:309] Setting ErrFile to fd 2...
I1101 23:28:07.212532 24185 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 23:28:07.212635 24185 root.go:334] Updating PATH: /home/jenkins/minikube-integration/15232-3880/.minikube/bin
I1101 23:28:07.213153 24185 out.go:303] Setting JSON to false
I1101 23:28:07.214037 24185 start.go:116] hostinfo: {"hostname":"ubuntu-20-agent-5","uptime":4241,"bootTime":1667341046,"procs":200,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1021-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1101 23:28:07.214103 24185 start.go:126] virtualization: kvm guest
I1101 23:28:07.216542 24185 out.go:177] * [test-preload-232607] minikube v1.27.1 on Ubuntu 20.04 (kvm/amd64)
I1101 23:28:07.218043 24185 out.go:177] - MINIKUBE_LOCATION=15232
I1101 23:28:07.217984 24185 notify.go:220] Checking for updates...
I1101 23:28:07.220784 24185 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1101 23:28:07.222352 24185 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/15232-3880/kubeconfig
I1101 23:28:07.223936 24185 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
I1101 23:28:07.225431 24185 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I1101 23:28:07.227176 24185 config.go:180] Loaded profile config "test-preload-232607": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.24.4
I1101 23:28:07.227602 24185 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:28:07.227673 24185 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:28:07.243385 24185 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:34017
I1101 23:28:07.243768 24185 main.go:134] libmachine: () Calling .GetVersion
I1101 23:28:07.244259 24185 main.go:134] libmachine: Using API Version 1
I1101 23:28:07.244288 24185 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:28:07.244627 24185 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:28:07.244787 24185 main.go:134] libmachine: (test-preload-232607) Calling .DriverName
I1101 23:28:07.246798 24185 out.go:177] * Kubernetes 1.25.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.25.3
I1101 23:28:07.248242 24185 driver.go:365] Setting default libvirt URI to qemu:///system
I1101 23:28:07.248528 24185 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:28:07.248557 24185 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:28:07.263008 24185 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:41383
I1101 23:28:07.263354 24185 main.go:134] libmachine: () Calling .GetVersion
I1101 23:28:07.263812 24185 main.go:134] libmachine: Using API Version 1
I1101 23:28:07.263834 24185 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:28:07.264149 24185 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:28:07.264322 24185 main.go:134] libmachine: (test-preload-232607) Calling .DriverName
I1101 23:28:07.299043 24185 out.go:177] * Using the kvm2 driver based on existing profile
I1101 23:28:07.300615 24185 start.go:282] selected driver: kvm2
I1101 23:28:07.300635 24185 start.go:808] validating driver "kvm2" against &{Name:test-preload-232607 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15232/minikube-v1.27.0-1666976405-15232-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-232607 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.211 Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/min
ikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1101 23:28:07.300747 24185 start.go:819] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1101 23:28:07.301318 24185 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1101 23:28:07.301530 24185 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/15232-3880/.minikube/bin:/home/jenkins/workspace/KVM_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I1101 23:28:07.316234 24185 install.go:137] /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2 version is 1.27.1
I1101 23:28:07.316558 24185 start_flags.go:888] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1101 23:28:07.316587 24185 cni.go:95] Creating CNI manager for ""
I1101 23:28:07.316600 24185 cni.go:165] "kvm2" driver + containerd runtime found, recommending bridge
I1101 23:28:07.316616 24185 start_flags.go:317] config:
{Name:test-preload-232607 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15232/minikube-v1.27.0-1666976405-15232-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.6 ClusterName:test-preload-232607 Namespace:defaul
t APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.211 Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144
MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1101 23:28:07.316727 24185 iso.go:124] acquiring lock: {Name:mk61da6294d889ca01904568b86a25258a195040 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1101 23:28:07.318746 24185 out.go:177] * Starting control plane node test-preload-232607 in cluster test-preload-232607
I1101 23:28:07.320216 24185 preload.go:132] Checking if preload exists for k8s version v1.24.6 and runtime containerd
I1101 23:28:07.476338 24185 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.24.6/preloaded-images-k8s-v18-v1.24.6-containerd-overlay2-amd64.tar.lz4
I1101 23:28:07.476363 24185 cache.go:57] Caching tarball of preloaded images
I1101 23:28:07.476531 24185 preload.go:132] Checking if preload exists for k8s version v1.24.6 and runtime containerd
I1101 23:28:07.478368 24185 out.go:177] * Downloading Kubernetes v1.24.6 preload ...
I1101 23:28:07.479699 24185 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.24.6-containerd-overlay2-amd64.tar.lz4 ...
I1101 23:28:07.628951 24185 download.go:101] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.24.6/preloaded-images-k8s-v18-v1.24.6-containerd-overlay2-amd64.tar.lz4?checksum=md5:0de094b674a9198bc47721c3b23603d5 -> /home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.6-containerd-overlay2-amd64.tar.lz4
I1101 23:28:19.393848 24185 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.24.6-containerd-overlay2-amd64.tar.lz4 ...
I1101 23:28:19.393939 24185 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.6-containerd-overlay2-amd64.tar.lz4 ...
I1101 23:28:20.270069 24185 cache.go:60] Finished verifying existence of preloaded tar for v1.24.6 on containerd
I1101 23:28:20.270201 24185 profile.go:148] Saving config to /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/config.json ...
I1101 23:28:20.270371 24185 cache.go:208] Successfully downloaded all kic artifacts
I1101 23:28:20.270399 24185 start.go:364] acquiring machines lock for test-preload-232607: {Name:mk0ceb2a54ab19909097a3b5db611a9647e1a223 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1101 23:28:20.270510 24185 start.go:368] acquired machines lock for "test-preload-232607" in 96.649µs
I1101 23:28:20.270530 24185 start.go:96] Skipping create...Using existing machine configuration
I1101 23:28:20.270534 24185 fix.go:55] fixHost starting:
I1101 23:28:20.270805 24185 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:28:20.270845 24185 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:28:20.285509 24185 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:45675
I1101 23:28:20.285886 24185 main.go:134] libmachine: () Calling .GetVersion
I1101 23:28:20.286341 24185 main.go:134] libmachine: Using API Version 1
I1101 23:28:20.286367 24185 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:28:20.286699 24185 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:28:20.286884 24185 main.go:134] libmachine: (test-preload-232607) Calling .DriverName
I1101 23:28:20.287030 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetState
I1101 23:28:20.288684 24185 fix.go:103] recreateIfNeeded on test-preload-232607: state=Running err=<nil>
W1101 23:28:20.288724 24185 fix.go:129] unexpected machine state, will restart: <nil>
I1101 23:28:20.290845 24185 out.go:177] * Updating the running kvm2 "test-preload-232607" VM ...
I1101 23:28:20.292234 24185 machine.go:88] provisioning docker machine ...
I1101 23:28:20.292263 24185 main.go:134] libmachine: (test-preload-232607) Calling .DriverName
I1101 23:28:20.292444 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetMachineName
I1101 23:28:20.292629 24185 buildroot.go:166] provisioning hostname "test-preload-232607"
I1101 23:28:20.292646 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetMachineName
I1101 23:28:20.292782 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHHostname
I1101 23:28:20.295213 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:20.295634 24185 main.go:134] libmachine: (test-preload-232607) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1f:ec:4c", ip: ""} in network mk-test-preload-232607: {Iface:virbr1 ExpiryTime:2022-11-02 00:26:22 +0000 UTC Type:0 Mac:52:54:00:1f:ec:4c Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:test-preload-232607 Clientid:01:52:54:00:1f:ec:4c}
I1101 23:28:20.295662 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined IP address 192.168.39.211 and MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:20.295925 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHPort
I1101 23:28:20.296099 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHKeyPath
I1101 23:28:20.296259 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHKeyPath
I1101 23:28:20.296430 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHUsername
I1101 23:28:20.296602 24185 main.go:134] libmachine: Using SSH client type: native
I1101 23:28:20.296783 24185 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7ed4e0] 0x7f0660 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I1101 23:28:20.296806 24185 main.go:134] libmachine: About to run SSH command:
sudo hostname test-preload-232607 && echo "test-preload-232607" | sudo tee /etc/hostname
I1101 23:28:20.445216 24185 main.go:134] libmachine: SSH cmd err, output: <nil>: test-preload-232607
I1101 23:28:20.445258 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHHostname
I1101 23:28:20.448292 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:20.448714 24185 main.go:134] libmachine: (test-preload-232607) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1f:ec:4c", ip: ""} in network mk-test-preload-232607: {Iface:virbr1 ExpiryTime:2022-11-02 00:26:22 +0000 UTC Type:0 Mac:52:54:00:1f:ec:4c Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:test-preload-232607 Clientid:01:52:54:00:1f:ec:4c}
I1101 23:28:20.448753 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined IP address 192.168.39.211 and MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:20.448886 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHPort
I1101 23:28:20.449108 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHKeyPath
I1101 23:28:20.449282 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHKeyPath
I1101 23:28:20.449434 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHUsername
I1101 23:28:20.449620 24185 main.go:134] libmachine: Using SSH client type: native
I1101 23:28:20.449760 24185 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7ed4e0] 0x7f0660 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I1101 23:28:20.449779 24185 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\stest-preload-232607' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 test-preload-232607/g' /etc/hosts;
else
echo '127.0.1.1 test-preload-232607' | sudo tee -a /etc/hosts;
fi
fi
I1101 23:28:20.583316 24185 main.go:134] libmachine: SSH cmd err, output: <nil>:
I1101 23:28:20.583350 24185 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/15232-3880/.minikube CaCertPath:/home/jenkins/minikube-integration/15232-3880/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/15232-3880/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/15232-3880/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/15232-3880/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/15232-3880/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/15232-3880/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/15232-3880/.minikube}
I1101 23:28:20.583375 24185 buildroot.go:174] setting up certificates
I1101 23:28:20.583387 24185 provision.go:83] configureAuth start
I1101 23:28:20.583399 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetMachineName
I1101 23:28:20.583665 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetIP
I1101 23:28:20.586367 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:20.586753 24185 main.go:134] libmachine: (test-preload-232607) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1f:ec:4c", ip: ""} in network mk-test-preload-232607: {Iface:virbr1 ExpiryTime:2022-11-02 00:26:22 +0000 UTC Type:0 Mac:52:54:00:1f:ec:4c Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:test-preload-232607 Clientid:01:52:54:00:1f:ec:4c}
I1101 23:28:20.586784 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined IP address 192.168.39.211 and MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:20.586975 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHHostname
I1101 23:28:20.589086 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:20.589379 24185 main.go:134] libmachine: (test-preload-232607) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1f:ec:4c", ip: ""} in network mk-test-preload-232607: {Iface:virbr1 ExpiryTime:2022-11-02 00:26:22 +0000 UTC Type:0 Mac:52:54:00:1f:ec:4c Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:test-preload-232607 Clientid:01:52:54:00:1f:ec:4c}
I1101 23:28:20.589402 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined IP address 192.168.39.211 and MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:20.589552 24185 provision.go:138] copyHostCerts
I1101 23:28:20.589602 24185 exec_runner.go:144] found /home/jenkins/minikube-integration/15232-3880/.minikube/cert.pem, removing ...
I1101 23:28:20.589614 24185 exec_runner.go:207] rm: /home/jenkins/minikube-integration/15232-3880/.minikube/cert.pem
I1101 23:28:20.589677 24185 exec_runner.go:151] cp: /home/jenkins/minikube-integration/15232-3880/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/15232-3880/.minikube/cert.pem (1123 bytes)
I1101 23:28:20.589755 24185 exec_runner.go:144] found /home/jenkins/minikube-integration/15232-3880/.minikube/key.pem, removing ...
I1101 23:28:20.589764 24185 exec_runner.go:207] rm: /home/jenkins/minikube-integration/15232-3880/.minikube/key.pem
I1101 23:28:20.589792 24185 exec_runner.go:151] cp: /home/jenkins/minikube-integration/15232-3880/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/15232-3880/.minikube/key.pem (1679 bytes)
I1101 23:28:20.589840 24185 exec_runner.go:144] found /home/jenkins/minikube-integration/15232-3880/.minikube/ca.pem, removing ...
I1101 23:28:20.589847 24185 exec_runner.go:207] rm: /home/jenkins/minikube-integration/15232-3880/.minikube/ca.pem
I1101 23:28:20.589876 24185 exec_runner.go:151] cp: /home/jenkins/minikube-integration/15232-3880/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/15232-3880/.minikube/ca.pem (1082 bytes)
I1101 23:28:20.589934 24185 provision.go:112] generating server cert: /home/jenkins/minikube-integration/15232-3880/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/15232-3880/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/15232-3880/.minikube/certs/ca-key.pem org=jenkins.test-preload-232607 san=[192.168.39.211 192.168.39.211 localhost 127.0.0.1 minikube test-preload-232607]
I1101 23:28:20.719840 24185 provision.go:172] copyRemoteCerts
I1101 23:28:20.719899 24185 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1101 23:28:20.719938 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHHostname
I1101 23:28:20.722488 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:20.722799 24185 main.go:134] libmachine: (test-preload-232607) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1f:ec:4c", ip: ""} in network mk-test-preload-232607: {Iface:virbr1 ExpiryTime:2022-11-02 00:26:22 +0000 UTC Type:0 Mac:52:54:00:1f:ec:4c Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:test-preload-232607 Clientid:01:52:54:00:1f:ec:4c}
I1101 23:28:20.722833 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined IP address 192.168.39.211 and MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:20.723036 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHPort
I1101 23:28:20.723307 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHKeyPath
I1101 23:28:20.723466 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHUsername
I1101 23:28:20.723610 24185 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/15232-3880/.minikube/machines/test-preload-232607/id_rsa Username:docker}
I1101 23:28:20.824746 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1101 23:28:20.870688 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I1101 23:28:20.898469 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1101 23:28:20.928057 24185 provision.go:86] duration metric: configureAuth took 344.658147ms
I1101 23:28:20.928082 24185 buildroot.go:189] setting minikube options for container-runtime
I1101 23:28:20.928232 24185 config.go:180] Loaded profile config "test-preload-232607": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.24.6
I1101 23:28:20.928243 24185 machine.go:91] provisioned docker machine in 635.991918ms
I1101 23:28:20.928250 24185 start.go:300] post-start starting for "test-preload-232607" (driver="kvm2")
I1101 23:28:20.928257 24185 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1101 23:28:20.928278 24185 main.go:134] libmachine: (test-preload-232607) Calling .DriverName
I1101 23:28:20.928572 24185 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1101 23:28:20.928604 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHHostname
I1101 23:28:20.931296 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:20.931676 24185 main.go:134] libmachine: (test-preload-232607) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1f:ec:4c", ip: ""} in network mk-test-preload-232607: {Iface:virbr1 ExpiryTime:2022-11-02 00:26:22 +0000 UTC Type:0 Mac:52:54:00:1f:ec:4c Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:test-preload-232607 Clientid:01:52:54:00:1f:ec:4c}
I1101 23:28:20.931706 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined IP address 192.168.39.211 and MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:20.931857 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHPort
I1101 23:28:20.932080 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHKeyPath
I1101 23:28:20.932247 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHUsername
I1101 23:28:20.932381 24185 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/15232-3880/.minikube/machines/test-preload-232607/id_rsa Username:docker}
I1101 23:28:21.032471 24185 ssh_runner.go:195] Run: cat /etc/os-release
I1101 23:28:21.037720 24185 info.go:137] Remote host: Buildroot 2021.02.12
I1101 23:28:21.037747 24185 filesync.go:126] Scanning /home/jenkins/minikube-integration/15232-3880/.minikube/addons for local assets ...
I1101 23:28:21.037867 24185 filesync.go:126] Scanning /home/jenkins/minikube-integration/15232-3880/.minikube/files for local assets ...
I1101 23:28:21.038012 24185 filesync.go:149] local asset: /home/jenkins/minikube-integration/15232-3880/.minikube/files/etc/ssl/certs/106712.pem -> 106712.pem in /etc/ssl/certs
I1101 23:28:21.038121 24185 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1101 23:28:21.047442 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/files/etc/ssl/certs/106712.pem --> /etc/ssl/certs/106712.pem (1708 bytes)
I1101 23:28:21.071873 24185 start.go:303] post-start completed in 143.611895ms
I1101 23:28:21.071895 24185 fix.go:57] fixHost completed within 801.359605ms
I1101 23:28:21.071919 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHHostname
I1101 23:28:21.074560 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:21.074830 24185 main.go:134] libmachine: (test-preload-232607) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1f:ec:4c", ip: ""} in network mk-test-preload-232607: {Iface:virbr1 ExpiryTime:2022-11-02 00:26:22 +0000 UTC Type:0 Mac:52:54:00:1f:ec:4c Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:test-preload-232607 Clientid:01:52:54:00:1f:ec:4c}
I1101 23:28:21.074861 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined IP address 192.168.39.211 and MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:21.075018 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHPort
I1101 23:28:21.075217 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHKeyPath
I1101 23:28:21.075381 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHKeyPath
I1101 23:28:21.075523 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHUsername
I1101 23:28:21.075659 24185 main.go:134] libmachine: Using SSH client type: native
I1101 23:28:21.075812 24185 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7ed4e0] 0x7f0660 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I1101 23:28:21.075828 24185 main.go:134] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I1101 23:28:21.207571 24185 main.go:134] libmachine: SSH cmd err, output: <nil>: 1667345301.204118009
I1101 23:28:21.207593 24185 fix.go:207] guest clock: 1667345301.204118009
I1101 23:28:21.207607 24185 fix.go:220] Guest: 2022-11-01 23:28:21.204118009 +0000 UTC Remote: 2022-11-01 23:28:21.071899391 +0000 UTC m=+13.919699239 (delta=132.218618ms)
I1101 23:28:21.207633 24185 fix.go:191] guest clock delta is within tolerance: 132.218618ms
I1101 23:28:21.207641 24185 start.go:83] releasing machines lock for "test-preload-232607", held for 937.117174ms
I1101 23:28:21.207688 24185 main.go:134] libmachine: (test-preload-232607) Calling .DriverName
I1101 23:28:21.207954 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetIP
I1101 23:28:21.210596 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:21.210984 24185 main.go:134] libmachine: (test-preload-232607) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1f:ec:4c", ip: ""} in network mk-test-preload-232607: {Iface:virbr1 ExpiryTime:2022-11-02 00:26:22 +0000 UTC Type:0 Mac:52:54:00:1f:ec:4c Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:test-preload-232607 Clientid:01:52:54:00:1f:ec:4c}
I1101 23:28:21.211015 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined IP address 192.168.39.211 and MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:21.211204 24185 main.go:134] libmachine: (test-preload-232607) Calling .DriverName
I1101 23:28:21.211704 24185 main.go:134] libmachine: (test-preload-232607) Calling .DriverName
I1101 23:28:21.211897 24185 main.go:134] libmachine: (test-preload-232607) Calling .DriverName
I1101 23:28:21.211982 24185 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I1101 23:28:21.212027 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHHostname
I1101 23:28:21.212144 24185 ssh_runner.go:195] Run: systemctl --version
I1101 23:28:21.212164 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHHostname
I1101 23:28:21.214623 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:21.214932 24185 main.go:134] libmachine: (test-preload-232607) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1f:ec:4c", ip: ""} in network mk-test-preload-232607: {Iface:virbr1 ExpiryTime:2022-11-02 00:26:22 +0000 UTC Type:0 Mac:52:54:00:1f:ec:4c Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:test-preload-232607 Clientid:01:52:54:00:1f:ec:4c}
I1101 23:28:21.214966 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined IP address 192.168.39.211 and MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:21.214985 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:21.215120 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHPort
I1101 23:28:21.215293 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHKeyPath
I1101 23:28:21.215434 24185 main.go:134] libmachine: (test-preload-232607) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1f:ec:4c", ip: ""} in network mk-test-preload-232607: {Iface:virbr1 ExpiryTime:2022-11-02 00:26:22 +0000 UTC Type:0 Mac:52:54:00:1f:ec:4c Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:test-preload-232607 Clientid:01:52:54:00:1f:ec:4c}
I1101 23:28:21.215459 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined IP address 192.168.39.211 and MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:21.215474 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHUsername
I1101 23:28:21.215630 24185 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/15232-3880/.minikube/machines/test-preload-232607/id_rsa Username:docker}
I1101 23:28:21.215701 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHPort
I1101 23:28:21.215856 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHKeyPath
I1101 23:28:21.216050 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHUsername
I1101 23:28:21.216204 24185 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/15232-3880/.minikube/machines/test-preload-232607/id_rsa Username:docker}
I1101 23:28:21.309157 24185 preload.go:132] Checking if preload exists for k8s version v1.24.6 and runtime containerd
I1101 23:28:21.309287 24185 ssh_runner.go:195] Run: sudo crictl images --output json
I1101 23:28:21.475779 24185 containerd.go:549] couldn't find preloaded image for "k8s.gcr.io/kube-apiserver:v1.24.6". assuming images are not preloaded.
I1101 23:28:21.475836 24185 ssh_runner.go:195] Run: which lz4
I1101 23:28:21.480231 24185 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I1101 23:28:21.484531 24185 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I1101 23:28:21.484560 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.6-containerd-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (458739102 bytes)
I1101 23:28:23.766043 24185 containerd.go:496] Took 2.285842 seconds to copy over tarball
I1101 23:28:23.766098 24185 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
I1101 23:28:27.068692 24185 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (3.302567702s)
I1101 23:28:27.068723 24185 containerd.go:503] Took 3.302656 seconds t extract the tarball
I1101 23:28:27.068735 24185 ssh_runner.go:146] rm: /preloaded.tar.lz4
I1101 23:28:27.113734 24185 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1101 23:28:27.257682 24185 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1101 23:28:27.480353 24185 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1101 23:28:27.497788 24185 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1101 23:28:27.512540 24185 docker.go:189] disabling docker service ...
I1101 23:28:27.512590 24185 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1101 23:28:27.528546 24185 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1101 23:28:27.543027 24185 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1101 23:28:27.703269 24185 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1101 23:28:27.836773 24185 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1101 23:28:27.851762 24185 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
image-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1101 23:28:27.882545 24185 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*sandbox_image = .*$|sandbox_image = "k8s.gcr.io/pause:3.7"|' -i /etc/containerd/config.toml"
I1101 23:28:27.893450 24185 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*restrict_oom_score_adj = .*$|restrict_oom_score_adj = false|' -i /etc/containerd/config.toml"
I1101 23:28:27.906659 24185 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*SystemdCgroup = .*$|SystemdCgroup = false|' -i /etc/containerd/config.toml"
I1101 23:28:27.916638 24185 ssh_runner.go:195] Run: /bin/bash -c "sudo sed -e 's|^.*conf_dir = .*$|conf_dir = "/etc/cni/net.d"|' -i /etc/containerd/config.toml"
I1101 23:28:27.926754 24185 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1101 23:28:27.936214 24185 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1101 23:28:27.945256 24185 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1101 23:28:28.088589 24185 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1101 23:28:28.261085 24185 start.go:451] Will wait 60s for socket path /run/containerd/containerd.sock
I1101 23:28:28.261157 24185 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1101 23:28:28.309516 24185 retry.go:31] will retry after 1.104660288s: stat /run/containerd/containerd.sock: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/run/containerd/containerd.sock': No such file or directory
I1101 23:28:29.414415 24185 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1101 23:28:29.419891 24185 retry.go:31] will retry after 2.160763633s: stat /run/containerd/containerd.sock: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/run/containerd/containerd.sock': No such file or directory
I1101 23:28:31.580936 24185 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1101 23:28:31.586405 24185 start.go:472] Will wait 60s for crictl version
I1101 23:28:31.586475 24185 ssh_runner.go:195] Run: sudo crictl version
I1101 23:28:31.666033 24185 start.go:481] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: v1.6.8
RuntimeApiVersion: v1alpha2
I1101 23:28:31.666094 24185 ssh_runner.go:195] Run: containerd --version
I1101 23:28:31.698896 24185 ssh_runner.go:195] Run: containerd --version
I1101 23:28:31.743887 24185 out.go:177] * Preparing Kubernetes v1.24.6 on containerd 1.6.8 ...
I1101 23:28:31.745453 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetIP
I1101 23:28:31.748168 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:31.748554 24185 main.go:134] libmachine: (test-preload-232607) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1f:ec:4c", ip: ""} in network mk-test-preload-232607: {Iface:virbr1 ExpiryTime:2022-11-02 00:26:22 +0000 UTC Type:0 Mac:52:54:00:1f:ec:4c Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:test-preload-232607 Clientid:01:52:54:00:1f:ec:4c}
I1101 23:28:31.748580 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined IP address 192.168.39.211 and MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:31.748781 24185 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I1101 23:28:31.753320 24185 preload.go:132] Checking if preload exists for k8s version v1.24.6 and runtime containerd
I1101 23:28:31.753383 24185 ssh_runner.go:195] Run: sudo crictl images --output json
I1101 23:28:31.786106 24185 containerd.go:553] all images are preloaded for containerd runtime.
I1101 23:28:31.786125 24185 containerd.go:467] Images already preloaded, skipping extraction
I1101 23:28:31.786165 24185 ssh_runner.go:195] Run: sudo crictl images --output json
I1101 23:28:31.817146 24185 containerd.go:553] all images are preloaded for containerd runtime.
I1101 23:28:31.817164 24185 cache_images.go:84] Images are preloaded, skipping loading
I1101 23:28:31.817207 24185 ssh_runner.go:195] Run: sudo crictl info
I1101 23:28:31.868666 24185 cni.go:95] Creating CNI manager for ""
I1101 23:28:31.868694 24185 cni.go:165] "kvm2" driver + containerd runtime found, recommending bridge
I1101 23:28:31.868705 24185 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I1101 23:28:31.868724 24185 kubeadm.go:156] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.211 APIServerPort:8443 KubernetesVersion:v1.24.6 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:test-preload-232607 NodeName:test-preload-232607 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.211"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.211 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false}
I1101 23:28:31.868897 24185 kubeadm.go:161] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.211
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "test-preload-232607"
kubeletExtraArgs:
node-ip: 192.168.39.211
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.211"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.24.6
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1101 23:28:31.868999 24185 kubeadm.go:962] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.24.6/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=test-preload-232607 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.211 --runtime-request-timeout=15m
[Install]
config:
{KubernetesVersion:v1.24.6 ClusterName:test-preload-232607 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I1101 23:28:31.869055 24185 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.6
I1101 23:28:31.882783 24185 binaries.go:44] Found k8s binaries, skipping transfer
I1101 23:28:31.882841 24185 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1101 23:28:31.900419 24185 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (514 bytes)
I1101 23:28:31.930928 24185 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1101 23:28:31.957006 24185 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2054 bytes)
I1101 23:28:31.986267 24185 ssh_runner.go:195] Run: grep 192.168.39.211 control-plane.minikube.internal$ /etc/hosts
I1101 23:28:31.990519 24185 certs.go:54] Setting up /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607 for IP: 192.168.39.211
I1101 23:28:31.990646 24185 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/15232-3880/.minikube/ca.key
I1101 23:28:31.990698 24185 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/15232-3880/.minikube/proxy-client-ca.key
I1101 23:28:31.990786 24185 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/client.key
I1101 23:28:31.990859 24185 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/apiserver.key.5ce1f1d4
I1101 23:28:31.990909 24185 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/proxy-client.key
I1101 23:28:31.991026 24185 certs.go:388] found cert: /home/jenkins/minikube-integration/15232-3880/.minikube/certs/home/jenkins/minikube-integration/15232-3880/.minikube/certs/10671.pem (1338 bytes)
W1101 23:28:31.991067 24185 certs.go:384] ignoring /home/jenkins/minikube-integration/15232-3880/.minikube/certs/home/jenkins/minikube-integration/15232-3880/.minikube/certs/10671_empty.pem, impossibly tiny 0 bytes
I1101 23:28:31.991085 24185 certs.go:388] found cert: /home/jenkins/minikube-integration/15232-3880/.minikube/certs/home/jenkins/minikube-integration/15232-3880/.minikube/certs/ca-key.pem (1675 bytes)
I1101 23:28:31.991134 24185 certs.go:388] found cert: /home/jenkins/minikube-integration/15232-3880/.minikube/certs/home/jenkins/minikube-integration/15232-3880/.minikube/certs/ca.pem (1082 bytes)
I1101 23:28:31.991171 24185 certs.go:388] found cert: /home/jenkins/minikube-integration/15232-3880/.minikube/certs/home/jenkins/minikube-integration/15232-3880/.minikube/certs/cert.pem (1123 bytes)
I1101 23:28:31.991203 24185 certs.go:388] found cert: /home/jenkins/minikube-integration/15232-3880/.minikube/certs/home/jenkins/minikube-integration/15232-3880/.minikube/certs/key.pem (1679 bytes)
I1101 23:28:31.991259 24185 certs.go:388] found cert: /home/jenkins/minikube-integration/15232-3880/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/15232-3880/.minikube/files/etc/ssl/certs/106712.pem (1708 bytes)
I1101 23:28:31.992046 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I1101 23:28:32.025807 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1101 23:28:32.109252 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1101 23:28:32.145510 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1101 23:28:32.179135 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1101 23:28:32.236610 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1101 23:28:32.279037 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1101 23:28:32.321901 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1101 23:28:32.345926 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/files/etc/ssl/certs/106712.pem --> /usr/share/ca-certificates/106712.pem (1708 bytes)
I1101 23:28:32.366726 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1101 23:28:32.387966 24185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15232-3880/.minikube/certs/10671.pem --> /usr/share/ca-certificates/10671.pem (1338 bytes)
I1101 23:28:32.409925 24185 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1101 23:28:32.425887 24185 ssh_runner.go:195] Run: openssl version
I1101 23:28:32.431318 24185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1101 23:28:32.441417 24185 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1101 23:28:32.446790 24185 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Nov 1 22:46 /usr/share/ca-certificates/minikubeCA.pem
I1101 23:28:32.446863 24185 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1101 23:28:32.452335 24185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1101 23:28:32.460355 24185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10671.pem && ln -fs /usr/share/ca-certificates/10671.pem /etc/ssl/certs/10671.pem"
I1101 23:28:32.469467 24185 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10671.pem
I1101 23:28:32.473836 24185 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Nov 1 22:53 /usr/share/ca-certificates/10671.pem
I1101 23:28:32.473884 24185 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10671.pem
I1101 23:28:32.479353 24185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/10671.pem /etc/ssl/certs/51391683.0"
I1101 23:28:32.487747 24185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/106712.pem && ln -fs /usr/share/ca-certificates/106712.pem /etc/ssl/certs/106712.pem"
I1101 23:28:32.496970 24185 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/106712.pem
I1101 23:28:32.501358 24185 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Nov 1 22:53 /usr/share/ca-certificates/106712.pem
I1101 23:28:32.501394 24185 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/106712.pem
I1101 23:28:32.507194 24185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/106712.pem /etc/ssl/certs/3ec20f2e.0"
I1101 23:28:32.515005 24185 kubeadm.go:396] StartCluster: {Name:test-preload-232607 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15232/minikube-v1.27.0-1666976405-15232-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVers
ion:v1.24.6 ClusterName:test-preload-232607 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.211 Port:8443 KubernetesVersion:v1.24.6 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9P
Version:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1101 23:28:32.515083 24185 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I1101 23:28:32.515122 24185 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1101 23:28:32.546941 24185 cri.go:87] found id: "28b497e71c1dfffefc215012e8216f990bef8b73d7ad17d54134f55683dc89b1"
I1101 23:28:32.546969 24185 cri.go:87] found id: "17e1f8f97ddb9676a26389886be3fd26d87af8be4f3373206040df6187d39928"
I1101 23:28:32.546980 24185 cri.go:87] found id: ""
I1101 23:28:32.547019 24185 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I1101 23:28:32.566529 24185 cri.go:114] JSON = [{"ociVersion":"1.0.2-dev","id":"23e1e26e01dfd43f733eb3f55f512ddbbbca3e3b582073d05465e4897246eba5","pid":3066,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/23e1e26e01dfd43f733eb3f55f512ddbbbca3e3b582073d05465e4897246eba5","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/23e1e26e01dfd43f733eb3f55f512ddbbbca3e3b582073d05465e4897246eba5/rootfs","created":"2022-11-01T23:28:32.238081284Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-cpu-period":"100000","io.kubernetes.cri.sandbox-cpu-quota":"0","io.kubernetes.cri.sandbox-cpu-shares":"2","io.kubernetes.cri.sandbox-id":"23e1e26e01dfd43f733eb3f55f512ddbbbca3e3b582073d05465e4897246eba5","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-proxy-ld6lh_01498287-7b3d-4b85-b685-2d3fd1cd8e37","io.kubernetes.cri.sandbox-memory":"0","io.kubernetes.cri.sandbox-name":"kube-proxy-ld6lh","io.kubernetes.cri.sand
box-namespace":"kube-system"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"28b497e71c1dfffefc215012e8216f990bef8b73d7ad17d54134f55683dc89b1","pid":3054,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/28b497e71c1dfffefc215012e8216f990bef8b73d7ad17d54134f55683dc89b1","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/28b497e71c1dfffefc215012e8216f990bef8b73d7ad17d54134f55683dc89b1/rootfs","created":"2022-11-01T23:28:32.222896731Z","annotations":{"io.kubernetes.cri.container-name":"coredns","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.image-name":"k8s.gcr.io/coredns/coredns:v1.8.6","io.kubernetes.cri.sandbox-id":"3a2162debe6634bc4db80428f31b69238853648bffc02b18fae464ba7d048e25","io.kubernetes.cri.sandbox-name":"coredns-6d4b75cb6d-g92wn","io.kubernetes.cri.sandbox-namespace":"kube-system"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"3a2162debe6634bc4db80428f31b69238853648bffc02b18fae464ba7d048e25","pid":2874,"status":"running","bundle":"/ru
n/containerd/io.containerd.runtime.v2.task/k8s.io/3a2162debe6634bc4db80428f31b69238853648bffc02b18fae464ba7d048e25","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/3a2162debe6634bc4db80428f31b69238853648bffc02b18fae464ba7d048e25/rootfs","created":"2022-11-01T23:28:31.275790635Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-cpu-period":"100000","io.kubernetes.cri.sandbox-cpu-quota":"0","io.kubernetes.cri.sandbox-cpu-shares":"102","io.kubernetes.cri.sandbox-id":"3a2162debe6634bc4db80428f31b69238853648bffc02b18fae464ba7d048e25","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_coredns-6d4b75cb6d-g92wn_b85acaf2-0e7d-4f18-a0c6-c5c76604191a","io.kubernetes.cri.sandbox-memory":"178257920","io.kubernetes.cri.sandbox-name":"coredns-6d4b75cb6d-g92wn","io.kubernetes.cri.sandbox-namespace":"kube-system"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"c68116770748cf60c09f68d17b799165eeefca28d795f8457e41a9e1e84cb559","pid":2881,"status":"running",
"bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/c68116770748cf60c09f68d17b799165eeefca28d795f8457e41a9e1e84cb559","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/c68116770748cf60c09f68d17b799165eeefca28d795f8457e41a9e1e84cb559/rootfs","created":"2022-11-01T23:28:31.250696079Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-cpu-period":"100000","io.kubernetes.cri.sandbox-cpu-quota":"0","io.kubernetes.cri.sandbox-cpu-shares":"2","io.kubernetes.cri.sandbox-id":"c68116770748cf60c09f68d17b799165eeefca28d795f8457e41a9e1e84cb559","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_storage-provisioner_801b8703-69d4-42b6-ab86-e6181f6c44ec","io.kubernetes.cri.sandbox-memory":"0","io.kubernetes.cri.sandbox-name":"storage-provisioner","io.kubernetes.cri.sandbox-namespace":"kube-system"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"dae245e1a173dbf6c73cf633be55bfc078d376d60bb694936912ba84cc2958c4","pid":2837,"status":"running","bundle
":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/dae245e1a173dbf6c73cf633be55bfc078d376d60bb694936912ba84cc2958c4","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/dae245e1a173dbf6c73cf633be55bfc078d376d60bb694936912ba84cc2958c4/rootfs","created":"2022-11-01T23:28:31.12222381Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-cpu-period":"100000","io.kubernetes.cri.sandbox-cpu-quota":"0","io.kubernetes.cri.sandbox-cpu-shares":"102","io.kubernetes.cri.sandbox-id":"dae245e1a173dbf6c73cf633be55bfc078d376d60bb694936912ba84cc2958c4","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-scheduler-test-preload-232607_24bce14278fb707359b40e7a5cf5c8d5","io.kubernetes.cri.sandbox-memory":"0","io.kubernetes.cri.sandbox-name":"kube-scheduler-test-preload-232607","io.kubernetes.cri.sandbox-namespace":"kube-system"},"owner":"root"}]
I1101 23:28:32.566661 24185 cri.go:124] list returned 5 containers
I1101 23:28:32.566681 24185 cri.go:127] container: {ID:23e1e26e01dfd43f733eb3f55f512ddbbbca3e3b582073d05465e4897246eba5 Status:running}
I1101 23:28:32.566709 24185 cri.go:129] skipping 23e1e26e01dfd43f733eb3f55f512ddbbbca3e3b582073d05465e4897246eba5 - not in ps
I1101 23:28:32.566721 24185 cri.go:127] container: {ID:28b497e71c1dfffefc215012e8216f990bef8b73d7ad17d54134f55683dc89b1 Status:running}
I1101 23:28:32.566730 24185 cri.go:133] skipping {28b497e71c1dfffefc215012e8216f990bef8b73d7ad17d54134f55683dc89b1 running}: state = "running", want "paused"
I1101 23:28:32.566744 24185 cri.go:127] container: {ID:3a2162debe6634bc4db80428f31b69238853648bffc02b18fae464ba7d048e25 Status:running}
I1101 23:28:32.566752 24185 cri.go:129] skipping 3a2162debe6634bc4db80428f31b69238853648bffc02b18fae464ba7d048e25 - not in ps
I1101 23:28:32.566763 24185 cri.go:127] container: {ID:c68116770748cf60c09f68d17b799165eeefca28d795f8457e41a9e1e84cb559 Status:running}
I1101 23:28:32.566775 24185 cri.go:129] skipping c68116770748cf60c09f68d17b799165eeefca28d795f8457e41a9e1e84cb559 - not in ps
I1101 23:28:32.566780 24185 cri.go:127] container: {ID:dae245e1a173dbf6c73cf633be55bfc078d376d60bb694936912ba84cc2958c4 Status:running}
I1101 23:28:32.566788 24185 cri.go:129] skipping dae245e1a173dbf6c73cf633be55bfc078d376d60bb694936912ba84cc2958c4 - not in ps
I1101 23:28:32.566834 24185 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1101 23:28:32.579781 24185 kubeadm.go:411] found existing configuration files, will attempt cluster restart
I1101 23:28:32.579801 24185 kubeadm.go:627] restartCluster start
I1101 23:28:32.579842 24185 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1101 23:28:32.591781 24185 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1101 23:28:32.592310 24185 kubeconfig.go:92] found "test-preload-232607" server: "https://192.168.39.211:8443"
I1101 23:28:32.592970 24185 kapi.go:59] client config for test-preload-232607: &rest.Config{Host:"https://192.168.39.211:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/client.crt", KeyFile:"/home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/client.key", CAFile:"/home/jenkins/minikube-integration/15232-3880/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil
), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1786820), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1101 23:28:32.593486 24185 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1101 23:28:32.604151 24185 kubeadm.go:594] needs reconfigure: configs differ:
-- stdout --
--- /var/tmp/minikube/kubeadm.yaml
+++ /var/tmp/minikube/kubeadm.yaml.new
@@ -38,7 +38,7 @@
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
-kubernetesVersion: v1.24.4
+kubernetesVersion: v1.24.6
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
-- /stdout --
I1101 23:28:32.604169 24185 kubeadm.go:1114] stopping kube-system containers ...
I1101 23:28:32.604179 24185 cri.go:52] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
I1101 23:28:32.604228 24185 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1101 23:28:32.644200 24185 cri.go:87] found id: "28b497e71c1dfffefc215012e8216f990bef8b73d7ad17d54134f55683dc89b1"
I1101 23:28:32.644228 24185 cri.go:87] found id: "17e1f8f97ddb9676a26389886be3fd26d87af8be4f3373206040df6187d39928"
I1101 23:28:32.644238 24185 cri.go:87] found id: ""
I1101 23:28:32.644243 24185 cri.go:232] Stopping containers: [28b497e71c1dfffefc215012e8216f990bef8b73d7ad17d54134f55683dc89b1 17e1f8f97ddb9676a26389886be3fd26d87af8be4f3373206040df6187d39928]
I1101 23:28:32.644293 24185 ssh_runner.go:195] Run: which crictl
I1101 23:28:32.648816 24185 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 28b497e71c1dfffefc215012e8216f990bef8b73d7ad17d54134f55683dc89b1 17e1f8f97ddb9676a26389886be3fd26d87af8be4f3373206040df6187d39928
I1101 23:28:32.779527 24185 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I1101 23:28:32.822235 24185 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1101 23:28:32.833824 24185 kubeadm.go:155] found existing configuration files:
-rw------- 1 root root 5643 Nov 1 23:26 /etc/kubernetes/admin.conf
-rw------- 1 root root 5658 Nov 1 23:26 /etc/kubernetes/controller-manager.conf
-rw------- 1 root root 2015 Nov 1 23:27 /etc/kubernetes/kubelet.conf
-rw------- 1 root root 5602 Nov 1 23:26 /etc/kubernetes/scheduler.conf
I1101 23:28:32.833901 24185 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1101 23:28:32.841918 24185 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1101 23:28:32.849657 24185 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1101 23:28:32.857400 24185 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1
stdout:
stderr:
I1101 23:28:32.857442 24185 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1101 23:28:32.865771 24185 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1101 23:28:32.873417 24185 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1
stdout:
stderr:
I1101 23:28:32.873458 24185 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1101 23:28:32.881317 24185 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1101 23:28:32.889773 24185 kubeadm.go:704] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
I1101 23:28:32.889793 24185 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.6:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I1101 23:28:33.001517 24185 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.6:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I1101 23:28:33.754252 24185 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.6:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I1101 23:28:34.125450 24185 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.6:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I1101 23:28:34.195179 24185 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.6:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I1101 23:28:34.284691 24185 api_server.go:51] waiting for apiserver process to appear ...
I1101 23:28:34.284781 24185 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1101 23:28:34.803454 24185 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1101 23:28:35.303082 24185 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1101 23:28:35.803619 24185 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1101 23:28:36.303121 24185 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1101 23:28:36.803097 24185 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1101 23:28:36.822385 24185 api_server.go:71] duration metric: took 2.537698144s to wait for apiserver process to appear ...
I1101 23:28:36.822415 24185 api_server.go:87] waiting for apiserver healthz status ...
I1101 23:28:36.822430 24185 api_server.go:252] Checking apiserver healthz at https://192.168.39.211:8443/healthz ...
I1101 23:28:36.822885 24185 api_server.go:268] stopped: https://192.168.39.211:8443/healthz: Get "https://192.168.39.211:8443/healthz": dial tcp 192.168.39.211:8443: connect: connection refused
I1101 23:28:37.324005 24185 api_server.go:252] Checking apiserver healthz at https://192.168.39.211:8443/healthz ...
I1101 23:28:40.683530 24185 api_server.go:278] https://192.168.39.211:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1101 23:28:40.683557 24185 api_server.go:102] status: https://192.168.39.211:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I1101 23:28:40.823794 24185 api_server.go:252] Checking apiserver healthz at https://192.168.39.211:8443/healthz ...
I1101 23:28:40.829889 24185 api_server.go:278] https://192.168.39.211:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1101 23:28:40.829919 24185 api_server.go:102] status: https://192.168.39.211:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1101 23:28:41.323469 24185 api_server.go:252] Checking apiserver healthz at https://192.168.39.211:8443/healthz ...
I1101 23:28:41.330549 24185 api_server.go:278] https://192.168.39.211:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1101 23:28:41.330573 24185 api_server.go:102] status: https://192.168.39.211:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1101 23:28:41.824035 24185 api_server.go:252] Checking apiserver healthz at https://192.168.39.211:8443/healthz ...
I1101 23:28:41.829039 24185 api_server.go:278] https://192.168.39.211:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W1101 23:28:41.829061 24185 api_server.go:102] status: https://192.168.39.211:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I1101 23:28:42.323756 24185 api_server.go:252] Checking apiserver healthz at https://192.168.39.211:8443/healthz ...
I1101 23:28:42.328850 24185 api_server.go:278] https://192.168.39.211:8443/healthz returned 200:
ok
I1101 23:28:42.335851 24185 api_server.go:140] control plane version: v1.24.6
I1101 23:28:42.335872 24185 api_server.go:130] duration metric: took 5.513451119s to wait for apiserver health ...
I1101 23:28:42.335879 24185 cni.go:95] Creating CNI manager for ""
I1101 23:28:42.335887 24185 cni.go:165] "kvm2" driver + containerd runtime found, recommending bridge
I1101 23:28:42.337966 24185 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I1101 23:28:42.339762 24185 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I1101 23:28:42.349209 24185 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I1101 23:28:42.367476 24185 system_pods.go:43] waiting for kube-system pods to appear ...
I1101 23:28:42.375519 24185 system_pods.go:59] 7 kube-system pods found
I1101 23:28:42.375545 24185 system_pods.go:61] "coredns-6d4b75cb6d-g92wn" [b85acaf2-0e7d-4f18-a0c6-c5c76604191a] Running
I1101 23:28:42.375549 24185 system_pods.go:61] "etcd-test-preload-232607" [6667207e-5994-4822-8cef-378db9373720] Running
I1101 23:28:42.375554 24185 system_pods.go:61] "kube-apiserver-test-preload-232607" [dac8234b-4617-4119-b4ee-e98e43b24216] Pending
I1101 23:28:42.375558 24185 system_pods.go:61] "kube-controller-manager-test-preload-232607" [904e5d94-81fe-459f-8c94-50b86df1104a] Pending
I1101 23:28:42.375565 24185 system_pods.go:61] "kube-proxy-ld6lh" [01498287-7b3d-4b85-b685-2d3fd1cd8e37] Running
I1101 23:28:42.375569 24185 system_pods.go:61] "kube-scheduler-test-preload-232607" [4a81bddb-78d2-435b-9bb6-885d6f32deef] Pending
I1101 23:28:42.375576 24185 system_pods.go:61] "storage-provisioner" [801b8703-69d4-42b6-ab86-e6181f6c44ec] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1101 23:28:42.375581 24185 system_pods.go:74] duration metric: took 8.08562ms to wait for pod list to return data ...
I1101 23:28:42.375589 24185 node_conditions.go:102] verifying NodePressure condition ...
I1101 23:28:42.378340 24185 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I1101 23:28:42.378365 24185 node_conditions.go:123] node cpu capacity is 2
I1101 23:28:42.378373 24185 node_conditions.go:105] duration metric: took 2.78046ms to run NodePressure ...
I1101 23:28:42.378386 24185 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.6:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I1101 23:28:42.609737 24185 kubeadm.go:763] waiting for restarted kubelet to initialise ...
I1101 23:28:42.613660 24185 kubeadm.go:778] kubelet initialised
I1101 23:28:42.613681 24185 kubeadm.go:779] duration metric: took 3.922281ms waiting for restarted kubelet to initialise ...
I1101 23:28:42.613687 24185 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1101 23:28:42.618212 24185 pod_ready.go:78] waiting up to 4m0s for pod "coredns-6d4b75cb6d-g92wn" in "kube-system" namespace to be "Ready" ...
I1101 23:28:42.622690 24185 pod_ready.go:92] pod "coredns-6d4b75cb6d-g92wn" in "kube-system" namespace has status "Ready":"True"
I1101 23:28:42.622707 24185 pod_ready.go:81] duration metric: took 4.470418ms waiting for pod "coredns-6d4b75cb6d-g92wn" in "kube-system" namespace to be "Ready" ...
I1101 23:28:42.622716 24185 pod_ready.go:78] waiting up to 4m0s for pod "etcd-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:42.627834 24185 pod_ready.go:92] pod "etcd-test-preload-232607" in "kube-system" namespace has status "Ready":"True"
I1101 23:28:42.627880 24185 pod_ready.go:81] duration metric: took 5.1299ms waiting for pod "etcd-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:42.627889 24185 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:44.646288 24185 pod_ready.go:102] pod "kube-apiserver-test-preload-232607" in "kube-system" namespace has status "Ready":"False"
I1101 23:28:47.138646 24185 pod_ready.go:92] pod "kube-apiserver-test-preload-232607" in "kube-system" namespace has status "Ready":"True"
I1101 23:28:47.138681 24185 pod_ready.go:81] duration metric: took 4.510784868s waiting for pod "kube-apiserver-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:47.138693 24185 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:49.150933 24185 pod_ready.go:102] pod "kube-controller-manager-test-preload-232607" in "kube-system" namespace has status "Ready":"False"
I1101 23:28:51.651887 24185 pod_ready.go:92] pod "kube-controller-manager-test-preload-232607" in "kube-system" namespace has status "Ready":"True"
I1101 23:28:51.651918 24185 pod_ready.go:81] duration metric: took 4.513216462s waiting for pod "kube-controller-manager-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:51.651928 24185 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-ld6lh" in "kube-system" namespace to be "Ready" ...
I1101 23:28:51.657467 24185 pod_ready.go:92] pod "kube-proxy-ld6lh" in "kube-system" namespace has status "Ready":"True"
I1101 23:28:51.657494 24185 pod_ready.go:81] duration metric: took 5.559077ms waiting for pod "kube-proxy-ld6lh" in "kube-system" namespace to be "Ready" ...
I1101 23:28:51.657506 24185 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:53.669976 24185 pod_ready.go:102] pod "kube-scheduler-test-preload-232607" in "kube-system" namespace has status "Ready":"False"
I1101 23:28:55.669071 24185 pod_ready.go:92] pod "kube-scheduler-test-preload-232607" in "kube-system" namespace has status "Ready":"True"
I1101 23:28:55.669100 24185 pod_ready.go:81] duration metric: took 4.011586584s waiting for pod "kube-scheduler-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:55.669113 24185 pod_ready.go:38] duration metric: took 13.055418117s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1101 23:28:55.669129 24185 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1101 23:28:55.679832 24185 ops.go:34] apiserver oom_adj: -16
I1101 23:28:55.679851 24185 kubeadm.go:631] restartCluster took 23.100044883s
I1101 23:28:55.679860 24185 kubeadm.go:398] StartCluster complete in 23.164858665s
I1101 23:28:55.679877 24185 settings.go:142] acquiring lock: {Name:mk247bf0c0fc06062ad4cfb8cc2c49394513b484 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1101 23:28:55.680001 24185 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/15232-3880/kubeconfig
I1101 23:28:55.680669 24185 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15232-3880/kubeconfig: {Name:mk71aa6d2439697955d6fb9e62112ba594689952 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1101 23:28:55.681278 24185 kapi.go:59] client config for test-preload-232607: &rest.Config{Host:"https://192.168.39.211:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/client.crt", KeyFile:"/home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/client.key", CAFile:"/home/jenkins/minikube-integration/15232-3880/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil
), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1786820), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1101 23:28:55.683744 24185 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "test-preload-232607" rescaled to 1
I1101 23:28:55.683799 24185 start.go:212] Will wait 6m0s for node &{Name: IP:192.168.39.211 Port:8443 KubernetesVersion:v1.24.6 ContainerRuntime:containerd ControlPlane:true Worker:true}
I1101 23:28:55.686524 24185 out.go:177] * Verifying Kubernetes components...
I1101 23:28:55.683843 24185 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.6/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1101 23:28:55.683862 24185 addons.go:412] enableAddons start: toEnable=map[default-storageclass:true storage-provisioner:true], additional=[]
I1101 23:28:55.684017 24185 config.go:180] Loaded profile config "test-preload-232607": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.24.6
I1101 23:28:55.687993 24185 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1101 23:28:55.688024 24185 addons.go:65] Setting storage-provisioner=true in profile "test-preload-232607"
I1101 23:28:55.688030 24185 addons.go:65] Setting default-storageclass=true in profile "test-preload-232607"
I1101 23:28:55.688045 24185 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "test-preload-232607"
I1101 23:28:55.688047 24185 addons.go:153] Setting addon storage-provisioner=true in "test-preload-232607"
W1101 23:28:55.688176 24185 addons.go:162] addon storage-provisioner should already be in state true
I1101 23:28:55.688219 24185 host.go:66] Checking if "test-preload-232607" exists ...
I1101 23:28:55.688355 24185 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:28:55.688395 24185 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:28:55.688550 24185 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:28:55.688592 24185 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:28:55.703755 24185 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:46619
I1101 23:28:55.704209 24185 main.go:134] libmachine: () Calling .GetVersion
I1101 23:28:55.704826 24185 main.go:134] libmachine: Using API Version 1
I1101 23:28:55.704871 24185 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:28:55.705190 24185 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:28:55.705496 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetState
I1101 23:28:55.707853 24185 kapi.go:59] client config for test-preload-232607: &rest.Config{Host:"https://192.168.39.211:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/client.crt", KeyFile:"/home/jenkins/minikube-integration/15232-3880/.minikube/profiles/test-preload-232607/client.key", CAFile:"/home/jenkins/minikube-integration/15232-3880/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil
), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1786820), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1101 23:28:55.707995 24185 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:41859
I1101 23:28:55.708332 24185 main.go:134] libmachine: () Calling .GetVersion
I1101 23:28:55.708754 24185 main.go:134] libmachine: Using API Version 1
I1101 23:28:55.708783 24185 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:28:55.709123 24185 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:28:55.709662 24185 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:28:55.709707 24185 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:28:55.714865 24185 addons.go:153] Setting addon default-storageclass=true in "test-preload-232607"
W1101 23:28:55.714889 24185 addons.go:162] addon default-storageclass should already be in state true
I1101 23:28:55.714918 24185 host.go:66] Checking if "test-preload-232607" exists ...
I1101 23:28:55.715285 24185 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:28:55.715330 24185 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:28:55.724740 24185 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:36893
I1101 23:28:55.725137 24185 main.go:134] libmachine: () Calling .GetVersion
I1101 23:28:55.725596 24185 main.go:134] libmachine: Using API Version 1
I1101 23:28:55.725620 24185 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:28:55.725940 24185 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:28:55.726108 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetState
I1101 23:28:55.727801 24185 main.go:134] libmachine: (test-preload-232607) Calling .DriverName
I1101 23:28:55.730297 24185 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1101 23:28:55.731726 24185 addons.go:345] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1101 23:28:55.731741 24185 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1101 23:28:55.731757 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHHostname
I1101 23:28:55.733558 24185 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:33687
I1101 23:28:55.733978 24185 main.go:134] libmachine: () Calling .GetVersion
I1101 23:28:55.734528 24185 main.go:134] libmachine: Using API Version 1
I1101 23:28:55.734557 24185 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:28:55.734942 24185 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:28:55.735145 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:55.735494 24185 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:28:55.735551 24185 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:28:55.735643 24185 main.go:134] libmachine: (test-preload-232607) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1f:ec:4c", ip: ""} in network mk-test-preload-232607: {Iface:virbr1 ExpiryTime:2022-11-02 00:26:22 +0000 UTC Type:0 Mac:52:54:00:1f:ec:4c Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:test-preload-232607 Clientid:01:52:54:00:1f:ec:4c}
I1101 23:28:55.735675 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined IP address 192.168.39.211 and MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:55.735869 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHPort
I1101 23:28:55.736065 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHKeyPath
I1101 23:28:55.736228 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHUsername
I1101 23:28:55.736385 24185 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/15232-3880/.minikube/machines/test-preload-232607/id_rsa Username:docker}
I1101 23:28:55.750266 24185 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:44243
I1101 23:28:55.750709 24185 main.go:134] libmachine: () Calling .GetVersion
I1101 23:28:55.751226 24185 main.go:134] libmachine: Using API Version 1
I1101 23:28:55.751249 24185 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:28:55.751556 24185 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:28:55.751752 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetState
I1101 23:28:55.753426 24185 main.go:134] libmachine: (test-preload-232607) Calling .DriverName
I1101 23:28:55.753657 24185 addons.go:345] installing /etc/kubernetes/addons/storageclass.yaml
I1101 23:28:55.753675 24185 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1101 23:28:55.753691 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHHostname
I1101 23:28:55.756569 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:55.756939 24185 main.go:134] libmachine: (test-preload-232607) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1f:ec:4c", ip: ""} in network mk-test-preload-232607: {Iface:virbr1 ExpiryTime:2022-11-02 00:26:22 +0000 UTC Type:0 Mac:52:54:00:1f:ec:4c Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:test-preload-232607 Clientid:01:52:54:00:1f:ec:4c}
I1101 23:28:55.756972 24185 main.go:134] libmachine: (test-preload-232607) DBG | domain test-preload-232607 has defined IP address 192.168.39.211 and MAC address 52:54:00:1f:ec:4c in network mk-test-preload-232607
I1101 23:28:55.757118 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHPort
I1101 23:28:55.757293 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHKeyPath
I1101 23:28:55.757439 24185 main.go:134] libmachine: (test-preload-232607) Calling .GetSSHUsername
I1101 23:28:55.757620 24185 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/15232-3880/.minikube/machines/test-preload-232607/id_rsa Username:docker}
I1101 23:28:55.842739 24185 node_ready.go:35] waiting up to 6m0s for node "test-preload-232607" to be "Ready" ...
I1101 23:28:55.844017 24185 start.go:806] CoreDNS already contains "host.minikube.internal" host record, skipping...
I1101 23:28:55.845446 24185 node_ready.go:49] node "test-preload-232607" has status "Ready":"True"
I1101 23:28:55.845461 24185 node_ready.go:38] duration metric: took 2.697275ms waiting for node "test-preload-232607" to be "Ready" ...
I1101 23:28:55.845469 24185 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1101 23:28:55.850037 24185 pod_ready.go:78] waiting up to 6m0s for pod "coredns-6d4b75cb6d-g92wn" in "kube-system" namespace to be "Ready" ...
I1101 23:28:55.855304 24185 pod_ready.go:92] pod "coredns-6d4b75cb6d-g92wn" in "kube-system" namespace has status "Ready":"True"
I1101 23:28:55.855319 24185 pod_ready.go:81] duration metric: took 5.261436ms waiting for pod "coredns-6d4b75cb6d-g92wn" in "kube-system" namespace to be "Ready" ...
I1101 23:28:55.855326 24185 pod_ready.go:78] waiting up to 6m0s for pod "etcd-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:55.859737 24185 pod_ready.go:92] pod "etcd-test-preload-232607" in "kube-system" namespace has status "Ready":"True"
I1101 23:28:55.859754 24185 pod_ready.go:81] duration metric: took 4.422472ms waiting for pod "etcd-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:55.859764 24185 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:55.864729 24185 pod_ready.go:92] pod "kube-apiserver-test-preload-232607" in "kube-system" namespace has status "Ready":"True"
I1101 23:28:55.864745 24185 pod_ready.go:81] duration metric: took 4.972743ms waiting for pod "kube-apiserver-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:55.864752 24185 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:55.878220 24185 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.6/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1101 23:28:55.883794 24185 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.6/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1101 23:28:56.066889 24185 pod_ready.go:92] pod "kube-controller-manager-test-preload-232607" in "kube-system" namespace has status "Ready":"True"
I1101 23:28:56.066910 24185 pod_ready.go:81] duration metric: took 202.151558ms waiting for pod "kube-controller-manager-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:56.066923 24185 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-xs9h8" in "kube-system" namespace to be "Ready" ...
I1101 23:28:56.467439 24185 pod_ready.go:92] pod "kube-proxy-xs9h8" in "kube-system" namespace has status "Ready":"True"
I1101 23:28:56.467467 24185 pod_ready.go:81] duration metric: took 400.535417ms waiting for pod "kube-proxy-xs9h8" in "kube-system" namespace to be "Ready" ...
I1101 23:28:56.467480 24185 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:56.729916 24185 main.go:134] libmachine: Making call to close driver server
I1101 23:28:56.729944 24185 main.go:134] libmachine: (test-preload-232607) Calling .Close
I1101 23:28:56.730308 24185 main.go:134] libmachine: (test-preload-232607) DBG | Closing plugin on server side
I1101 23:28:56.730338 24185 main.go:134] libmachine: Successfully made call to close driver server
I1101 23:28:56.730351 24185 main.go:134] libmachine: Making call to close connection to plugin binary
I1101 23:28:56.730361 24185 main.go:134] libmachine: Making call to close driver server
I1101 23:28:56.730378 24185 main.go:134] libmachine: (test-preload-232607) Calling .Close
I1101 23:28:56.730624 24185 main.go:134] libmachine: Successfully made call to close driver server
I1101 23:28:56.730654 24185 main.go:134] libmachine: Making call to close connection to plugin binary
I1101 23:28:56.730674 24185 main.go:134] libmachine: (test-preload-232607) DBG | Closing plugin on server side
I1101 23:28:56.730680 24185 main.go:134] libmachine: Making call to close driver server
I1101 23:28:56.730696 24185 main.go:134] libmachine: (test-preload-232607) Calling .Close
I1101 23:28:56.730902 24185 main.go:134] libmachine: (test-preload-232607) DBG | Closing plugin on server side
I1101 23:28:56.730955 24185 main.go:134] libmachine: Successfully made call to close driver server
I1101 23:28:56.730979 24185 main.go:134] libmachine: Making call to close connection to plugin binary
I1101 23:28:56.788737 24185 main.go:134] libmachine: Making call to close driver server
I1101 23:28:56.788761 24185 main.go:134] libmachine: (test-preload-232607) Calling .Close
I1101 23:28:56.789065 24185 main.go:134] libmachine: (test-preload-232607) DBG | Closing plugin on server side
I1101 23:28:56.789102 24185 main.go:134] libmachine: Successfully made call to close driver server
I1101 23:28:56.789121 24185 main.go:134] libmachine: Making call to close connection to plugin binary
I1101 23:28:56.789133 24185 main.go:134] libmachine: Making call to close driver server
I1101 23:28:56.789143 24185 main.go:134] libmachine: (test-preload-232607) Calling .Close
I1101 23:28:56.789390 24185 main.go:134] libmachine: Successfully made call to close driver server
I1101 23:28:56.789411 24185 main.go:134] libmachine: Making call to close connection to plugin binary
I1101 23:28:56.792783 24185 out.go:177] * Enabled addons: default-storageclass, storage-provisioner
I1101 23:28:56.794373 24185 addons.go:414] enableAddons completed in 1.110516497s
I1101 23:28:56.867130 24185 pod_ready.go:92] pod "kube-scheduler-test-preload-232607" in "kube-system" namespace has status "Ready":"True"
I1101 23:28:56.867150 24185 pod_ready.go:81] duration metric: took 399.663179ms waiting for pod "kube-scheduler-test-preload-232607" in "kube-system" namespace to be "Ready" ...
I1101 23:28:56.867159 24185 pod_ready.go:38] duration metric: took 1.021683325s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1101 23:28:56.867171 24185 api_server.go:51] waiting for apiserver process to appear ...
I1101 23:28:56.867208 24185 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1101 23:28:56.879631 24185 api_server.go:71] duration metric: took 1.195800021s to wait for apiserver process to appear ...
I1101 23:28:56.879658 24185 api_server.go:87] waiting for apiserver healthz status ...
I1101 23:28:56.879666 24185 api_server.go:252] Checking apiserver healthz at https://192.168.39.211:8443/healthz ...
I1101 23:28:56.885186 24185 api_server.go:278] https://192.168.39.211:8443/healthz returned 200:
ok
I1101 23:28:56.886191 24185 api_server.go:140] control plane version: v1.24.6
I1101 23:28:56.886216 24185 api_server.go:130] duration metric: took 6.551047ms to wait for apiserver health ...
I1101 23:28:56.886226 24185 system_pods.go:43] waiting for kube-system pods to appear ...
I1101 23:28:57.074475 24185 system_pods.go:59] 7 kube-system pods found
I1101 23:28:57.074505 24185 system_pods.go:61] "coredns-6d4b75cb6d-g92wn" [b85acaf2-0e7d-4f18-a0c6-c5c76604191a] Running
I1101 23:28:57.074510 24185 system_pods.go:61] "etcd-test-preload-232607" [6667207e-5994-4822-8cef-378db9373720] Running
I1101 23:28:57.074514 24185 system_pods.go:61] "kube-apiserver-test-preload-232607" [dac8234b-4617-4119-b4ee-e98e43b24216] Running
I1101 23:28:57.074519 24185 system_pods.go:61] "kube-controller-manager-test-preload-232607" [904e5d94-81fe-459f-8c94-50b86df1104a] Running
I1101 23:28:57.074523 24185 system_pods.go:61] "kube-proxy-xs9h8" [c1f36e00-964b-412d-98ed-819011296362] Running
I1101 23:28:57.074527 24185 system_pods.go:61] "kube-scheduler-test-preload-232607" [4a81bddb-78d2-435b-9bb6-885d6f32deef] Running
I1101 23:28:57.074535 24185 system_pods.go:61] "storage-provisioner" [801b8703-69d4-42b6-ab86-e6181f6c44ec] Running
I1101 23:28:57.074539 24185 system_pods.go:74] duration metric: took 188.308536ms to wait for pod list to return data ...
I1101 23:28:57.074546 24185 default_sa.go:34] waiting for default service account to be created ...
I1101 23:28:57.268747 24185 default_sa.go:45] found service account: "default"
I1101 23:28:57.268771 24185 default_sa.go:55] duration metric: took 194.220424ms for default service account to be created ...
I1101 23:28:57.268778 24185 system_pods.go:116] waiting for k8s-apps to be running ...
I1101 23:28:57.470359 24185 system_pods.go:86] 7 kube-system pods found
I1101 23:28:57.470388 24185 system_pods.go:89] "coredns-6d4b75cb6d-g92wn" [b85acaf2-0e7d-4f18-a0c6-c5c76604191a] Running
I1101 23:28:57.470394 24185 system_pods.go:89] "etcd-test-preload-232607" [6667207e-5994-4822-8cef-378db9373720] Running
I1101 23:28:57.470398 24185 system_pods.go:89] "kube-apiserver-test-preload-232607" [dac8234b-4617-4119-b4ee-e98e43b24216] Running
I1101 23:28:57.470402 24185 system_pods.go:89] "kube-controller-manager-test-preload-232607" [904e5d94-81fe-459f-8c94-50b86df1104a] Running
I1101 23:28:57.470407 24185 system_pods.go:89] "kube-proxy-xs9h8" [c1f36e00-964b-412d-98ed-819011296362] Running
I1101 23:28:57.470411 24185 system_pods.go:89] "kube-scheduler-test-preload-232607" [4a81bddb-78d2-435b-9bb6-885d6f32deef] Running
I1101 23:28:57.470415 24185 system_pods.go:89] "storage-provisioner" [801b8703-69d4-42b6-ab86-e6181f6c44ec] Running
I1101 23:28:57.470420 24185 system_pods.go:126] duration metric: took 201.638107ms to wait for k8s-apps to be running ...
I1101 23:28:57.470426 24185 system_svc.go:44] waiting for kubelet service to be running ....
I1101 23:28:57.470489 24185 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1101 23:28:57.483312 24185 system_svc.go:56] duration metric: took 12.867648ms WaitForService to wait for kubelet.
I1101 23:28:57.483352 24185 kubeadm.go:573] duration metric: took 1.79951137s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
I1101 23:28:57.483385 24185 node_conditions.go:102] verifying NodePressure condition ...
I1101 23:28:57.667534 24185 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I1101 23:28:57.667568 24185 node_conditions.go:123] node cpu capacity is 2
I1101 23:28:57.667583 24185 node_conditions.go:105] duration metric: took 184.192623ms to run NodePressure ...
I1101 23:28:57.667596 24185 start.go:217] waiting for startup goroutines ...
I1101 23:28:57.667883 24185 ssh_runner.go:195] Run: rm -f paused
I1101 23:28:57.711802 24185 start.go:506] kubectl: 1.25.3, cluster: 1.24.6 (minor skew: 1)
I1101 23:28:57.715173 24185 out.go:177] * Done! kubectl is now configured to use "test-preload-232607" cluster and "default" namespace by default
*
* ==> container status <==
* CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID
83b921239bb6f 0bb39497ab33b 3 seconds ago Running kube-proxy 0 c0f57c6eda093
998f599f4c646 6e38f40d628db 15 seconds ago Running storage-provisioner 2 c68116770748c
68b4a7c26791d a4ca41631cc7a 15 seconds ago Running coredns 2 3a2162debe663
f76cd797857dc c786c777a4e1c 22 seconds ago Running kube-scheduler 0 1ea079f382ba8
4c70e810d5b21 aebe758cef4cd 22 seconds ago Running etcd 1 d1a6bcdfbb4bf
72080e459318b c6c20157a4233 23 seconds ago Running kube-controller-manager 0 34d95700cad3c
9f04eb062c6f2 860f263331c95 23 seconds ago Running kube-apiserver 0 337e8d5db9464
28b497e71c1df a4ca41631cc7a 26 seconds ago Exited coredns 1 3a2162debe663
17e1f8f97ddb9 6e38f40d628db 26 seconds ago Exited storage-provisioner 1 c68116770748c
*
* ==> containerd <==
* -- Journal begins at Tue 2022-11-01 23:26:18 UTC, ends at Tue 2022-11-01 23:28:58 UTC. --
Nov 01 23:28:53 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:53.424403790Z" level=info msg="shim disconnected" id=b97444734e30e1a0d7ce347a663a873247086e853aa33c00dcc38af0bb78b2e9
Nov 01 23:28:53 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:53.424491625Z" level=warning msg="cleaning up after shim disconnected" id=b97444734e30e1a0d7ce347a663a873247086e853aa33c00dcc38af0bb78b2e9 namespace=k8s.io
Nov 01 23:28:53 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:53.424505151Z" level=info msg="cleaning up dead shim"
Nov 01 23:28:53 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:53.437202552Z" level=warning msg="cleanup warnings time=\"2022-11-01T23:28:53Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3846 runtime=io.containerd.runc.v2\n"
Nov 01 23:28:53 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:53.442253184Z" level=info msg="StopContainer for \"b97444734e30e1a0d7ce347a663a873247086e853aa33c00dcc38af0bb78b2e9\" returns successfully"
Nov 01 23:28:53 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:53.442917433Z" level=info msg="StopPodSandbox for \"23e1e26e01dfd43f733eb3f55f512ddbbbca3e3b582073d05465e4897246eba5\""
Nov 01 23:28:53 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:53.443067658Z" level=info msg="Container to stop \"b97444734e30e1a0d7ce347a663a873247086e853aa33c00dcc38af0bb78b2e9\" must be in running or unknown state, current state \"CONTAINER_EXITED\""
Nov 01 23:28:53 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:53.497879314Z" level=info msg="shim disconnected" id=23e1e26e01dfd43f733eb3f55f512ddbbbca3e3b582073d05465e4897246eba5
Nov 01 23:28:53 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:53.498185395Z" level=warning msg="cleaning up after shim disconnected" id=23e1e26e01dfd43f733eb3f55f512ddbbbca3e3b582073d05465e4897246eba5 namespace=k8s.io
Nov 01 23:28:53 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:53.498329721Z" level=info msg="cleaning up dead shim"
Nov 01 23:28:53 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:53.514752257Z" level=warning msg="cleanup warnings time=\"2022-11-01T23:28:53Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3883 runtime=io.containerd.runc.v2\n"
Nov 01 23:28:53 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:53.515433101Z" level=info msg="TearDown network for sandbox \"23e1e26e01dfd43f733eb3f55f512ddbbbca3e3b582073d05465e4897246eba5\" successfully"
Nov 01 23:28:53 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:53.515651546Z" level=info msg="StopPodSandbox for \"23e1e26e01dfd43f733eb3f55f512ddbbbca3e3b582073d05465e4897246eba5\" returns successfully"
Nov 01 23:28:54 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:54.498552569Z" level=info msg="RemoveContainer for \"b97444734e30e1a0d7ce347a663a873247086e853aa33c00dcc38af0bb78b2e9\""
Nov 01 23:28:54 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:54.506679703Z" level=info msg="RemoveContainer for \"b97444734e30e1a0d7ce347a663a873247086e853aa33c00dcc38af0bb78b2e9\" returns successfully"
Nov 01 23:28:54 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:54.871577531Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-xs9h8,Uid:c1f36e00-964b-412d-98ed-819011296362,Namespace:kube-system,Attempt:0,}"
Nov 01 23:28:54 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:54.895931728Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Nov 01 23:28:54 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:54.896094296Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 01 23:28:54 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:54.896105685Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Nov 01 23:28:54 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:54.896587947Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/c0f57c6eda093fcdc4979d30b604b995e36372df86d500c0d6f8c46f45a0d2d9 pid=3906 runtime=io.containerd.runc.v2
Nov 01 23:28:54 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:54.958316124Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-xs9h8,Uid:c1f36e00-964b-412d-98ed-819011296362,Namespace:kube-system,Attempt:0,} returns sandbox id \"c0f57c6eda093fcdc4979d30b604b995e36372df86d500c0d6f8c46f45a0d2d9\""
Nov 01 23:28:54 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:54.962014022Z" level=info msg="CreateContainer within sandbox \"c0f57c6eda093fcdc4979d30b604b995e36372df86d500c0d6f8c46f45a0d2d9\" for container &ContainerMetadata{Name:kube-proxy,Attempt:0,}"
Nov 01 23:28:54 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:54.993079783Z" level=info msg="CreateContainer within sandbox \"c0f57c6eda093fcdc4979d30b604b995e36372df86d500c0d6f8c46f45a0d2d9\" for &ContainerMetadata{Name:kube-proxy,Attempt:0,} returns container id \"83b921239bb6fc0bd4204b708ac585eb98cfce224a7347a78f44be83ab644eff\""
Nov 01 23:28:54 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:54.995925894Z" level=info msg="StartContainer for \"83b921239bb6fc0bd4204b708ac585eb98cfce224a7347a78f44be83ab644eff\""
Nov 01 23:28:55 test-preload-232607 containerd[2532]: time="2022-11-01T23:28:55.077068449Z" level=info msg="StartContainer for \"83b921239bb6fc0bd4204b708ac585eb98cfce224a7347a78f44be83ab644eff\" returns successfully"
*
* ==> coredns [28b497e71c1dfffefc215012e8216f990bef8b73d7ad17d54134f55683dc89b1] <==
*
*
* ==> coredns [68b4a7c26791d218b4a671c3d61a06caa6daaff959414c2c503fe19d951de9b9] <==
* .:53
[INFO] plugin/reload: Running configuration MD5 = 8f51b271a18f2ce6fcaee5f1cfda3ed0
CoreDNS-1.8.6
linux/amd64, go1.17.1, 13a9191
*
* ==> describe nodes <==
* Name: test-preload-232607
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=test-preload-232607
kubernetes.io/os=linux
minikube.k8s.io/commit=65bfd3dc2bf9824cf305579b01895f56b2ba9210
minikube.k8s.io/name=test-preload-232607
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2022_11_01T23_27_09_0700
minikube.k8s.io/version=v1.27.1
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 01 Nov 2022 23:27:06 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: test-preload-232607
AcquireTime: <unset>
RenewTime: Tue, 01 Nov 2022 23:28:50 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 01 Nov 2022 23:28:40 +0000 Tue, 01 Nov 2022 23:27:02 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 01 Nov 2022 23:28:40 +0000 Tue, 01 Nov 2022 23:27:02 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 01 Nov 2022 23:28:40 +0000 Tue, 01 Nov 2022 23:27:02 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 01 Nov 2022 23:28:40 +0000 Tue, 01 Nov 2022 23:27:19 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.211
Hostname: test-preload-232607
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: e782d3c6b55c47ea9cded6e6b3c80aa7
System UUID: e782d3c6-b55c-47ea-9cde-d6e6b3c80aa7
Boot ID: d4fd23c0-7941-4a15-927c-444cb35a9f92
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: containerd://1.6.8
Kubelet Version: v1.24.6
Kube-Proxy Version: v1.24.6
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (7 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-6d4b75cb6d-g92wn 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 97s
kube-system etcd-test-preload-232607 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 110s
kube-system kube-apiserver-test-preload-232607 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 18s
kube-system kube-controller-manager-test-preload-232607 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 18s
kube-system kube-proxy-xs9h8 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5s
kube-system kube-scheduler-test-preload-232607 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 17s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 94s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 0 (0%!)(MISSING)
memory 170Mi (8%!)(MISSING) 170Mi (8%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 94s kube-proxy
Normal Starting 13s kube-proxy
Normal Starting 3s kube-proxy
Normal NodeHasSufficientMemory 2m (x4 over 2m) kubelet Node test-preload-232607 status is now: NodeHasSufficientMemory
Normal NodeHasSufficientPID 2m (x4 over 2m) kubelet Node test-preload-232607 status is now: NodeHasSufficientPID
Normal NodeHasNoDiskPressure 2m (x4 over 2m) kubelet Node test-preload-232607 status is now: NodeHasNoDiskPressure
Normal Starting 110s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 110s kubelet Node test-preload-232607 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 110s kubelet Node test-preload-232607 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 110s kubelet Node test-preload-232607 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 110s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 100s kubelet Node test-preload-232607 status is now: NodeReady
Normal RegisteredNode 97s node-controller Node test-preload-232607 event: Registered Node test-preload-232607 in Controller
Normal NodeHasSufficientMemory 25s (x8 over 25s) kubelet Node test-preload-232607 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 25s (x8 over 25s) kubelet Node test-preload-232607 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 25s (x7 over 25s) kubelet Node test-preload-232607 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 25s kubelet Updated Node Allocatable limit across pods
Normal Starting 25s kubelet Starting kubelet.
Normal RegisteredNode 6s node-controller Node test-preload-232607 event: Registered Node test-preload-232607 in Controller
*
* ==> dmesg <==
* [Nov 1 23:26] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.072334] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +3.969221] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.131687] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.129748] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +4.951096] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +8.021092] systemd-fstab-generator[550]: Ignoring "noauto" for root device
[ +0.113330] systemd-fstab-generator[561]: Ignoring "noauto" for root device
[ +0.194922] systemd-fstab-generator[584]: Ignoring "noauto" for root device
[ +27.551338] systemd-fstab-generator[988]: Ignoring "noauto" for root device
[Nov 1 23:27] systemd-fstab-generator[1380]: Ignoring "noauto" for root device
[ +13.797872] kauditd_printk_skb: 7 callbacks suppressed
[ +11.460992] kauditd_printk_skb: 22 callbacks suppressed
[Nov 1 23:28] kauditd_printk_skb: 4 callbacks suppressed
[ +24.218009] systemd-fstab-generator[2435]: Ignoring "noauto" for root device
[ +0.436603] systemd-fstab-generator[2467]: Ignoring "noauto" for root device
[ +0.154228] systemd-fstab-generator[2486]: Ignoring "noauto" for root device
[ +0.233498] systemd-fstab-generator[2522]: Ignoring "noauto" for root device
[ +6.049485] systemd-fstab-generator[3237]: Ignoring "noauto" for root device
*
* ==> etcd [4c70e810d5b2191aaa246a17d6c1c641d7aba5a9357fc68b0a7f8fb7e7f95748] <==
* {"level":"info","ts":"2022-11-01T23:28:37.100Z","caller":"etcdserver/server.go:851","msg":"starting etcd server","local-member-id":"d3f1da2044f49cdd","local-server-version":"3.5.3","cluster-version":"to_be_decided"}
{"level":"info","ts":"2022-11-01T23:28:37.108Z","caller":"etcdserver/server.go:752","msg":"starting initial election tick advance","election-ticks":10}
{"level":"info","ts":"2022-11-01T23:28:37.109Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d3f1da2044f49cdd switched to configuration voters=(15272227643520752861)"}
{"level":"info","ts":"2022-11-01T23:28:37.110Z","caller":"embed/etcd.go:688","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2022-11-01T23:28:37.110Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"a3f4522b5c780b58","local-member-id":"d3f1da2044f49cdd","added-peer-id":"d3f1da2044f49cdd","added-peer-peer-urls":["https://192.168.39.211:2380"]}
{"level":"info","ts":"2022-11-01T23:28:37.114Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"a3f4522b5c780b58","local-member-id":"d3f1da2044f49cdd","cluster-version":"3.5"}
{"level":"info","ts":"2022-11-01T23:28:37.114Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2022-11-01T23:28:37.115Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"d3f1da2044f49cdd","initial-advertise-peer-urls":["https://192.168.39.211:2380"],"listen-peer-urls":["https://192.168.39.211:2380"],"advertise-client-urls":["https://192.168.39.211:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.39.211:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2022-11-01T23:28:37.115Z","caller":"embed/etcd.go:763","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2022-11-01T23:28:37.110Z","caller":"embed/etcd.go:581","msg":"serving peer traffic","address":"192.168.39.211:2380"}
{"level":"info","ts":"2022-11-01T23:28:37.120Z","caller":"embed/etcd.go:553","msg":"cmux::serve","address":"192.168.39.211:2380"}
{"level":"info","ts":"2022-11-01T23:28:38.159Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d3f1da2044f49cdd is starting a new election at term 2"}
{"level":"info","ts":"2022-11-01T23:28:38.159Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d3f1da2044f49cdd became pre-candidate at term 2"}
{"level":"info","ts":"2022-11-01T23:28:38.159Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d3f1da2044f49cdd received MsgPreVoteResp from d3f1da2044f49cdd at term 2"}
{"level":"info","ts":"2022-11-01T23:28:38.159Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d3f1da2044f49cdd became candidate at term 3"}
{"level":"info","ts":"2022-11-01T23:28:38.159Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d3f1da2044f49cdd received MsgVoteResp from d3f1da2044f49cdd at term 3"}
{"level":"info","ts":"2022-11-01T23:28:38.159Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d3f1da2044f49cdd became leader at term 3"}
{"level":"info","ts":"2022-11-01T23:28:38.159Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: d3f1da2044f49cdd elected leader d3f1da2044f49cdd at term 3"}
{"level":"info","ts":"2022-11-01T23:28:38.160Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"d3f1da2044f49cdd","local-member-attributes":"{Name:test-preload-232607 ClientURLs:[https://192.168.39.211:2379]}","request-path":"/0/members/d3f1da2044f49cdd/attributes","cluster-id":"a3f4522b5c780b58","publish-timeout":"7s"}
{"level":"info","ts":"2022-11-01T23:28:38.160Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
{"level":"info","ts":"2022-11-01T23:28:38.162Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.39.211:2379"}
{"level":"info","ts":"2022-11-01T23:28:38.163Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
{"level":"info","ts":"2022-11-01T23:28:38.164Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
{"level":"info","ts":"2022-11-01T23:28:38.164Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2022-11-01T23:28:38.164Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
*
* ==> kernel <==
* 23:28:59 up 2 min, 0 users, load average: 1.91, 0.71, 0.26
Linux test-preload-232607 5.10.57 #1 SMP Fri Oct 28 21:02:11 UTC 2022 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
*
* ==> kube-apiserver [9f04eb062c6f28d5c259bc0959d90b6e47b32cf2bb9a849177c56db91a959c93] <==
* I1101 23:28:40.665451 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I1101 23:28:40.665532 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I1101 23:28:40.665730 1 crd_finalizer.go:266] Starting CRDFinalizer
I1101 23:28:40.670441 1 crdregistration_controller.go:111] Starting crd-autoregister controller
I1101 23:28:40.670527 1 shared_informer.go:255] Waiting for caches to sync for crd-autoregister
I1101 23:28:40.725404 1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io
E1101 23:28:40.742222 1 controller.go:169] Error removing old endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
I1101 23:28:40.771058 1 shared_informer.go:262] Caches are synced for crd-autoregister
I1101 23:28:40.807934 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I1101 23:28:40.816532 1 shared_informer.go:262] Caches are synced for cluster_authentication_trust_controller
I1101 23:28:40.818348 1 cache.go:39] Caches are synced for autoregister controller
I1101 23:28:40.818489 1 cache.go:39] Caches are synced for AvailableConditionController controller
I1101 23:28:40.818780 1 shared_informer.go:262] Caches are synced for node_authorizer
I1101 23:28:40.818889 1 apf_controller.go:322] Running API Priority and Fairness config worker
I1101 23:28:41.264326 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I1101 23:28:41.612082 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I1101 23:28:42.529522 1 controller.go:611] quota admission added evaluator for: serviceaccounts
I1101 23:28:42.537379 1 controller.go:611] quota admission added evaluator for: deployments.apps
I1101 23:28:42.570679 1 controller.go:611] quota admission added evaluator for: daemonsets.apps
I1101 23:28:42.592266 1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1101 23:28:42.598897 1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1101 23:28:45.502429 1 controller.go:611] quota admission added evaluator for: events.events.k8s.io
I1101 23:28:53.229341 1 controller.go:611] quota admission added evaluator for: endpoints
I1101 23:28:53.245098 1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps
I1101 23:28:53.309387 1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io
*
* ==> kube-controller-manager [72080e459318bc31f41f462ccfcf653e481bd42b45bca6cdb5245af57ff4375f] <==
* I1101 23:28:53.276890 1 shared_informer.go:262] Caches are synced for node
I1101 23:28:53.277016 1 range_allocator.go:173] Starting range CIDR allocator
I1101 23:28:53.277028 1 shared_informer.go:255] Waiting for caches to sync for cidrallocator
I1101 23:28:53.277037 1 shared_informer.go:262] Caches are synced for cidrallocator
I1101 23:28:53.277781 1 shared_informer.go:262] Caches are synced for endpoint_slice
I1101 23:28:53.283086 1 shared_informer.go:262] Caches are synced for endpoint_slice_mirroring
I1101 23:28:53.285335 1 shared_informer.go:262] Caches are synced for certificate-csrapproving
I1101 23:28:53.289046 1 shared_informer.go:262] Caches are synced for stateful set
I1101 23:28:53.289220 1 shared_informer.go:262] Caches are synced for deployment
I1101 23:28:53.289665 1 shared_informer.go:262] Caches are synced for attach detach
I1101 23:28:53.293853 1 shared_informer.go:262] Caches are synced for certificate-csrsigning-kubelet-serving
I1101 23:28:53.411627 1 shared_informer.go:262] Caches are synced for taint
I1101 23:28:53.412240 1 taint_manager.go:187] "Starting NoExecuteTaintManager"
I1101 23:28:53.414842 1 node_lifecycle_controller.go:1399] Initializing eviction metric for zone:
W1101 23:28:53.415570 1 node_lifecycle_controller.go:1014] Missing timestamp for Node test-preload-232607. Assuming now as a timestamp.
I1101 23:28:53.416018 1 node_lifecycle_controller.go:1215] Controller detected that zone is now in state Normal.
I1101 23:28:53.415422 1 event.go:294] "Event occurred" object="test-preload-232607" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node test-preload-232607 event: Registered Node test-preload-232607 in Controller"
I1101 23:28:53.438149 1 shared_informer.go:262] Caches are synced for disruption
I1101 23:28:53.438214 1 disruption.go:371] Sending events to api server.
I1101 23:28:53.449568 1 shared_informer.go:262] Caches are synced for resource quota
I1101 23:28:53.461145 1 shared_informer.go:262] Caches are synced for resource quota
I1101 23:28:53.906597 1 shared_informer.go:262] Caches are synced for garbage collector
I1101 23:28:53.929381 1 shared_informer.go:262] Caches are synced for garbage collector
I1101 23:28:53.929437 1 garbagecollector.go:158] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I1101 23:28:54.552192 1 event.go:294] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-xs9h8"
*
* ==> kube-proxy [83b921239bb6fc0bd4204b708ac585eb98cfce224a7347a78f44be83ab644eff] <==
* I1101 23:28:55.188334 1 node.go:163] Successfully retrieved node IP: 192.168.39.211
I1101 23:28:55.188453 1 server_others.go:138] "Detected node IP" address="192.168.39.211"
I1101 23:28:55.188550 1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
I1101 23:28:55.275291 1 server_others.go:199] "kube-proxy running in single-stack mode, this ipFamily is not supported" ipFamily=IPv6
I1101 23:28:55.275357 1 server_others.go:206] "Using iptables Proxier"
I1101 23:28:55.275424 1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
I1101 23:28:55.276470 1 server.go:661] "Version info" version="v1.24.6"
I1101 23:28:55.276608 1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1101 23:28:55.278434 1 config.go:317] "Starting service config controller"
I1101 23:28:55.278839 1 shared_informer.go:255] Waiting for caches to sync for service config
I1101 23:28:55.279111 1 config.go:226] "Starting endpoint slice config controller"
I1101 23:28:55.279143 1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
I1101 23:28:55.279450 1 config.go:444] "Starting node config controller"
I1101 23:28:55.279607 1 shared_informer.go:255] Waiting for caches to sync for node config
I1101 23:28:55.379232 1 shared_informer.go:262] Caches are synced for service config
I1101 23:28:55.380262 1 shared_informer.go:262] Caches are synced for node config
I1101 23:28:55.380361 1 shared_informer.go:262] Caches are synced for endpoint slice config
*
* ==> kube-scheduler [f76cd797857dc35db419cac774970119de5017ec8d67a0975e86efdd7921862b] <==
* I1101 23:28:37.714286 1 serving.go:348] Generated self-signed cert in-memory
W1101 23:28:40.691431 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1101 23:28:40.691571 1 authentication.go:346] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1101 23:28:40.691712 1 authentication.go:347] Continuing without authentication configuration. This may treat all requests as anonymous.
W1101 23:28:40.691746 1 authentication.go:348] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1101 23:28:40.748274 1 server.go:147] "Starting Kubernetes Scheduler" version="v1.24.6"
I1101 23:28:40.748320 1 server.go:149] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1101 23:28:40.750931 1 secure_serving.go:210] Serving securely on 127.0.0.1:10259
I1101 23:28:40.752311 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1101 23:28:40.752332 1 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1101 23:28:40.752354 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I1101 23:28:40.852774 1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
*
* ==> kubelet <==
* -- Journal begins at Tue 2022-11-01 23:26:18 UTC, ends at Tue 2022-11-01 23:28:59 UTC. --
Nov 01 23:28:42 test-preload-232607 kubelet[3243]: I1101 23:28:42.782884 3243 scope.go:110] "RemoveContainer" containerID="28b497e71c1dfffefc215012e8216f990bef8b73d7ad17d54134f55683dc89b1"
Nov 01 23:28:44 test-preload-232607 kubelet[3243]: I1101 23:28:44.385023 3243 kubelet_volumes.go:160] "Cleaned up orphaned pod volumes dir" podUID=24bce14278fb707359b40e7a5cf5c8d5 path="/var/lib/kubelet/pods/24bce14278fb707359b40e7a5cf5c8d5/volumes"
Nov 01 23:28:51 test-preload-232607 kubelet[3243]: I1101 23:28:51.532191 3243 prober_manager.go:274] "Failed to trigger a manual run" probe="Readiness"
Nov 01 23:28:53 test-preload-232607 kubelet[3243]: I1101 23:28:53.631454 3243 reconciler.go:201] "operationExecutor.UnmountVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/01498287-7b3d-4b85-b685-2d3fd1cd8e37-kube-proxy\") pod \"01498287-7b3d-4b85-b685-2d3fd1cd8e37\" (UID: \"01498287-7b3d-4b85-b685-2d3fd1cd8e37\") "
Nov 01 23:28:53 test-preload-232607 kubelet[3243]: I1101 23:28:53.631532 3243 reconciler.go:201] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmbcj\" (UniqueName: \"kubernetes.io/projected/01498287-7b3d-4b85-b685-2d3fd1cd8e37-kube-api-access-cmbcj\") pod \"01498287-7b3d-4b85-b685-2d3fd1cd8e37\" (UID: \"01498287-7b3d-4b85-b685-2d3fd1cd8e37\") "
Nov 01 23:28:53 test-preload-232607 kubelet[3243]: I1101 23:28:53.631555 3243 reconciler.go:201] "operationExecutor.UnmountVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/01498287-7b3d-4b85-b685-2d3fd1cd8e37-xtables-lock\") pod \"01498287-7b3d-4b85-b685-2d3fd1cd8e37\" (UID: \"01498287-7b3d-4b85-b685-2d3fd1cd8e37\") "
Nov 01 23:28:53 test-preload-232607 kubelet[3243]: I1101 23:28:53.631576 3243 reconciler.go:201] "operationExecutor.UnmountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01498287-7b3d-4b85-b685-2d3fd1cd8e37-lib-modules\") pod \"01498287-7b3d-4b85-b685-2d3fd1cd8e37\" (UID: \"01498287-7b3d-4b85-b685-2d3fd1cd8e37\") "
Nov 01 23:28:53 test-preload-232607 kubelet[3243]: I1101 23:28:53.631622 3243 operation_generator.go:863] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/01498287-7b3d-4b85-b685-2d3fd1cd8e37-lib-modules" (OuterVolumeSpecName: "lib-modules") pod "01498287-7b3d-4b85-b685-2d3fd1cd8e37" (UID: "01498287-7b3d-4b85-b685-2d3fd1cd8e37"). InnerVolumeSpecName "lib-modules". PluginName "kubernetes.io/host-path", VolumeGidValue ""
Nov 01 23:28:53 test-preload-232607 kubelet[3243]: W1101 23:28:53.633039 3243 empty_dir.go:519] Warning: Failed to clear quota on /var/lib/kubelet/pods/01498287-7b3d-4b85-b685-2d3fd1cd8e37/volumes/kubernetes.io~configmap/kube-proxy: clearQuota called, but quotas disabled
Nov 01 23:28:53 test-preload-232607 kubelet[3243]: I1101 23:28:53.633419 3243 operation_generator.go:863] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01498287-7b3d-4b85-b685-2d3fd1cd8e37-kube-proxy" (OuterVolumeSpecName: "kube-proxy") pod "01498287-7b3d-4b85-b685-2d3fd1cd8e37" (UID: "01498287-7b3d-4b85-b685-2d3fd1cd8e37"). InnerVolumeSpecName "kube-proxy". PluginName "kubernetes.io/configmap", VolumeGidValue ""
Nov 01 23:28:53 test-preload-232607 kubelet[3243]: I1101 23:28:53.633471 3243 operation_generator.go:863] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/01498287-7b3d-4b85-b685-2d3fd1cd8e37-xtables-lock" (OuterVolumeSpecName: "xtables-lock") pod "01498287-7b3d-4b85-b685-2d3fd1cd8e37" (UID: "01498287-7b3d-4b85-b685-2d3fd1cd8e37"). InnerVolumeSpecName "xtables-lock". PluginName "kubernetes.io/host-path", VolumeGidValue ""
Nov 01 23:28:53 test-preload-232607 kubelet[3243]: I1101 23:28:53.637403 3243 operation_generator.go:863] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01498287-7b3d-4b85-b685-2d3fd1cd8e37-kube-api-access-cmbcj" (OuterVolumeSpecName: "kube-api-access-cmbcj") pod "01498287-7b3d-4b85-b685-2d3fd1cd8e37" (UID: "01498287-7b3d-4b85-b685-2d3fd1cd8e37"). InnerVolumeSpecName "kube-api-access-cmbcj". PluginName "kubernetes.io/projected", VolumeGidValue ""
Nov 01 23:28:53 test-preload-232607 kubelet[3243]: I1101 23:28:53.732691 3243 reconciler.go:384] "Volume detached for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/01498287-7b3d-4b85-b685-2d3fd1cd8e37-kube-proxy\") on node \"test-preload-232607\" DevicePath \"\""
Nov 01 23:28:53 test-preload-232607 kubelet[3243]: I1101 23:28:53.732783 3243 reconciler.go:384] "Volume detached for volume \"kube-api-access-cmbcj\" (UniqueName: \"kubernetes.io/projected/01498287-7b3d-4b85-b685-2d3fd1cd8e37-kube-api-access-cmbcj\") on node \"test-preload-232607\" DevicePath \"\""
Nov 01 23:28:53 test-preload-232607 kubelet[3243]: I1101 23:28:53.732794 3243 reconciler.go:384] "Volume detached for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/01498287-7b3d-4b85-b685-2d3fd1cd8e37-xtables-lock\") on node \"test-preload-232607\" DevicePath \"\""
Nov 01 23:28:53 test-preload-232607 kubelet[3243]: I1101 23:28:53.732806 3243 reconciler.go:384] "Volume detached for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01498287-7b3d-4b85-b685-2d3fd1cd8e37-lib-modules\") on node \"test-preload-232607\" DevicePath \"\""
Nov 01 23:28:54 test-preload-232607 kubelet[3243]: I1101 23:28:54.494433 3243 scope.go:110] "RemoveContainer" containerID="b97444734e30e1a0d7ce347a663a873247086e853aa33c00dcc38af0bb78b2e9"
Nov 01 23:28:54 test-preload-232607 kubelet[3243]: I1101 23:28:54.560059 3243 topology_manager.go:200] "Topology Admit Handler"
Nov 01 23:28:54 test-preload-232607 kubelet[3243]: E1101 23:28:54.560138 3243 cpu_manager.go:394] "RemoveStaleState: removing container" podUID="01498287-7b3d-4b85-b685-2d3fd1cd8e37" containerName="kube-proxy"
Nov 01 23:28:54 test-preload-232607 kubelet[3243]: I1101 23:28:54.560171 3243 memory_manager.go:345] "RemoveStaleState removing state" podUID="01498287-7b3d-4b85-b685-2d3fd1cd8e37" containerName="kube-proxy"
Nov 01 23:28:54 test-preload-232607 kubelet[3243]: I1101 23:28:54.638501 3243 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/c1f36e00-964b-412d-98ed-819011296362-xtables-lock\") pod \"kube-proxy-xs9h8\" (UID: \"c1f36e00-964b-412d-98ed-819011296362\") " pod="kube-system/kube-proxy-xs9h8"
Nov 01 23:28:54 test-preload-232607 kubelet[3243]: I1101 23:28:54.638578 3243 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dbjz\" (UniqueName: \"kubernetes.io/projected/c1f36e00-964b-412d-98ed-819011296362-kube-api-access-7dbjz\") pod \"kube-proxy-xs9h8\" (UID: \"c1f36e00-964b-412d-98ed-819011296362\") " pod="kube-system/kube-proxy-xs9h8"
Nov 01 23:28:54 test-preload-232607 kubelet[3243]: I1101 23:28:54.638608 3243 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/c1f36e00-964b-412d-98ed-819011296362-kube-proxy\") pod \"kube-proxy-xs9h8\" (UID: \"c1f36e00-964b-412d-98ed-819011296362\") " pod="kube-system/kube-proxy-xs9h8"
Nov 01 23:28:54 test-preload-232607 kubelet[3243]: I1101 23:28:54.638626 3243 reconciler.go:342] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1f36e00-964b-412d-98ed-819011296362-lib-modules\") pod \"kube-proxy-xs9h8\" (UID: \"c1f36e00-964b-412d-98ed-819011296362\") " pod="kube-system/kube-proxy-xs9h8"
Nov 01 23:28:56 test-preload-232607 kubelet[3243]: I1101 23:28:56.384160 3243 kubelet_volumes.go:160] "Cleaned up orphaned pod volumes dir" podUID=01498287-7b3d-4b85-b685-2d3fd1cd8e37 path="/var/lib/kubelet/pods/01498287-7b3d-4b85-b685-2d3fd1cd8e37/volumes"
*
* ==> storage-provisioner [17e1f8f97ddb9676a26389886be3fd26d87af8be4f3373206040df6187d39928] <==
* I1101 23:28:32.085893 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F1101 23:28:32.090590 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: connect: connection refused
*
* ==> storage-provisioner [998f599f4c646f81d4a3b57b13ffbe68ac9c4381ecaf41de4d19234ff72c42ac] <==
* I1101 23:28:43.146700 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1101 23:28:43.157423 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1101 23:28:43.157782 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p test-preload-232607 -n test-preload-232607
helpers_test.go:261: (dbg) Run: kubectl --context test-preload-232607 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods:
helpers_test.go:272: ======> post-mortem[TestPreload]: describe non-running pods <======
helpers_test.go:275: (dbg) Run: kubectl --context test-preload-232607 describe pod
helpers_test.go:275: (dbg) Non-zero exit: kubectl --context test-preload-232607 describe pod : exit status 1 (46.523261ms)
** stderr **
error: resource name may not be empty
** /stderr **
helpers_test.go:277: kubectl --context test-preload-232607 describe pod : exit status 1
helpers_test.go:175: Cleaning up "test-preload-232607" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p test-preload-232607
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p test-preload-232607: (1.160602368s)
--- FAIL: TestPreload (173.71s)
=== RUN TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:190: (dbg) Run: /tmp/minikube-v1.16.0.3804431926.exe start -p stopped-upgrade-233206 --memory=2200 --vm-driver=kvm2 --container-runtime=containerd
=== CONT TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:190: (dbg) Non-zero exit: /tmp/minikube-v1.16.0.3804431926.exe start -p stopped-upgrade-233206 --memory=2200 --vm-driver=kvm2 --container-runtime=containerd: exit status 80 (9m45.253174346s)
-- stdout --
* [stopped-upgrade-233206] minikube v1.16.0 on Ubuntu 20.04
- MINIKUBE_LOCATION=15232
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- KUBECONFIG=/tmp/legacy_kubeconfig3550527866
* Using the kvm2 driver based on user configuration
* minikube 1.27.1 is available! Download it: https://github.com/kubernetes/minikube/releases/tag/v1.27.1
* To disable this notice, run: 'minikube config set WantUpdateNotification false'
* Downloading VM boot image ...
* Starting control plane node stopped-upgrade-233206 in cluster stopped-upgrade-233206
* Downloading Kubernetes v1.20.0 preload ...
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on containerd 1.4.3 ...
- Generating certificates and keys ...| WW[K[K
* Configuring bridge CNI (Container Networking Interface) ...
- Booting up control plane ...
- Configuring RBAC rules .../ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K
* Verifying Kubernetes components...
* Enabled addons:
- Nov 01 23:39:14 stopped-upgrade-233206 kubelet[3024]: E1101 23:39:14.983302 3024 pod_workers.go:191] Error syncing pod f8d3d61ad8d45c80ab92bcedbe7fdb7d ("kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"), skipping: failed to "StartContainer" for "kube-controller-manager" with RunContainerError: "failed to create containerd task: ttrpc: closed: unknown"
- Nov 01 23:39:14 stopped-upgrade-233206 kubelet[3024]: E1101 23:39:14.983302 3024 pod_workers.go:191] Error syncing pod f8d3d61ad8d45c80ab92bcedbe7fdb7d ("kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"), skipping: failed to "StartContainer" for "kube-controller-manager" with RunContainerError: "failed to create containerd task: ttrpc: closed: unknown"
- Nov 01 23:39:18 stopped-upgrade-233206 kubelet[3024]: E1101 23:39:18.999549 3024 pod_workers.go:191] Error syncing pod 5c713e66724f2deda8ea3fc397d8f018 ("etcd-stopped-upgrade-233206_kube-system(5c713e66724f2deda8ea3fc397d8f018)"), skipping: failed to "StartContainer" for "etcd" with CrashLoopBackOff: "back-off 10s restarting failed container=etcd pod=etcd-stopped-upgrade-233206_kube-system(5c713e66724f2deda8ea3fc397d8f018)"
- Nov 01 23:39:20 stopped-upgrade-233206 kubelet[3024]: E1101 23:39:20.040812 3024 pod_workers.go:191] Error syncing pod 5c713e66724f2deda8ea3fc397d8f018 ("etcd-stopped-upgrade-233206_kube-system(5c713e66724f2deda8ea3fc397d8f018)"), skipping: failed to "StartContainer" for "etcd" with CrashLoopBackOff: "back-off 10s restarting failed container=etcd pod=etcd-stopped-upgrade-233206_kube-system(5c713e66724f2deda8ea3fc397d8f018)"
- Nov 01 23:39:23 stopped-upgrade-233206 kubelet[3024]: E1101 23:39:23.584249 3024 pod_workers.go:191] Error syncing pod 5c713e66724f2deda8ea3fc397d8f018 ("etcd-stopped-upgrade-233206_kube-system(5c713e66724f2deda8ea3fc397d8f018)"), skipping: failed to "StartContainer" for "etcd" with CrashLoopBackOff: "back-off 10s restarting failed container=etcd pod=etcd-stopped-upgrade-233206_kube-system(5c713e66724f2deda8ea3fc397d8f018)"
- 2022-11-01 23:39:17.809521 C | etcdmain: listen tcp 192.168.72.24:2380: bind: address already in use
- 2022-11-01 23:39:17.809521 C | etcdmain: listen tcp 192.168.72.24:2380: bind: address already in use
- Nov 01 23:39:23 stopped-upgrade-233206 kubelet[3024]: E1101 23:39:23.584249 3024 pod_workers.go:191] Error syncing pod 5c713e66724f2deda8ea3fc397d8f018 ("etcd-stopped-upgrade-233206_kube-system(5c713e66724f2deda8ea3fc397d8f018)"), skipping: failed to "StartContainer" for "etcd" with CrashLoopBackOff: "back-off 10s restarting failed container=etcd pod=etcd-stopped-upgrade-233206_kube-system(5c713e66724f2deda8ea3fc397d8f018)"
- Nov 01 23:39:30 stopped-upgrade-233206 kubelet[3024]: E1101 23:39:30.136253 3024 pod_workers.go:191] Error syncing pod ebf9f15fc19c1d9b40d93e25aa884c8e ("kube-apiserver-stopped-upgrade-233206_kube-system(ebf9f15fc19c1d9b40d93e25aa884c8e)"), skipping: failed to "StartContainer" for "kube-apiserver" with CrashLoopBackOff: "back-off 10s restarting failed container=kube-apiserver pod=kube-apiserver-stopped-upgrade-233206_kube-system(ebf9f15fc19c1d9b40d93e25aa884c8e)"
- Nov 01 23:39:31 stopped-upgrade-233206 kubelet[3024]: E1101 23:39:31.130712 3024 pod_workers.go:191] Error syncing pod ebf9f15fc19c1d9b40d93e25aa884c8e ("kube-apiserver-stopped-upgrade-233206_kube-system(ebf9f15fc19c1d9b40d93e25aa884c8e)"), skipping: failed to "StartContainer" for "kube-apiserver" with CrashLoopBackOff: "back-off 10s restarting failed container=kube-apiserver pod=kube-apiserver-stopped-upgrade-233206_kube-system(ebf9f15fc19c1d9b40d93e25aa884c8e)"
- Nov 01 23:39:36 stopped-upgrade-233206 kubelet[3024]: E1101 23:39:36.144768 3024 pod_workers.go:191] Error syncing pod f8d3d61ad8d45c80ab92bcedbe7fdb7d ("kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"), skipping: failed to "StartContainer" for "kube-controller-manager" with CrashLoopBackOff: "back-off 10s restarting failed container=kube-controller-manager pod=kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"
- Nov 01 23:39:40 stopped-upgrade-233206 kubelet[3024]: E1101 23:39:40.166400 3024 pod_workers.go:191] Error syncing pod f8d3d61ad8d45c80ab92bcedbe7fdb7d ("kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"), skipping: failed to "StartContainer" for "kube-controller-manager" with CrashLoopBackOff: "back-off 10s restarting failed container=kube-controller-manager pod=kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"
- 2022-11-01 23:39:17.809521 C | etcdmain: listen tcp 192.168.72.24:2380: bind: address already in use
-- /stdout --
** stderr **
> minikube-v1.16.0.iso.sha256: 65 B / 65 B [-------------] 100.00% ? p/s 0s > minikube-v1.16.0.iso: 3.96 MiB / 212.62 MiB [>____________] 1.86% ? p/s ? > minikube-v1.16.0.iso: 5.96 MiB / 212.62 MiB [>____________] 2.80% ? p/s ? > minikube-v1.16.0.iso: 10.73 MiB / 212.62 MiB [>___________] 5.04% ? p/s ? > minikube-v1.16.0.iso: 12.12 MiB / 212.62 MiB 5.70% 13.61 MiB p/s ETA 14s > minikube-v1.16.0.iso: 19.85 MiB / 212.62 MiB 9.33% 13.61 MiB p/s ETA 14s > minikube-v1.16.0.iso: 24.00 MiB / 212.62 MiB 11.29% 13.61 MiB p/s ETA 13 > minikube-v1.16.0.iso: 24.00 MiB / 212.62 MiB 11.29% 14.01 MiB p/s ETA 13 > minikube-v1.16.0.iso: 46.52 MiB / 212.62 MiB 21.88% 14.01 MiB p/s ETA 11 > minikube-v1.16.0.iso: 48.00 MiB / 212.62 MiB 22.58% 14.01 MiB p/s ETA 11 > minikube-v1.16.0.iso: 56.00 MiB / 212.62 MiB 26.34% 16.55 MiB p/s ETA 9s > minikube-v1.16.0.iso: 74.09 MiB / 212.62 MiB 34.85% 16.55 MiB p/s ETA 8s > minikube-v1.16.0.iso: 80.00 MiB / 212.62 MiB 37.63% 16.55 Mi
B p/s ETA 8s > minikube-v1.16.0.iso: 104.00 MiB / 212.62 MiB 48.91% 20.64 MiB p/s ETA 5 > minikube-v1.16.0.iso: 104.00 MiB / 212.62 MiB 48.91% 20.64 MiB p/s ETA 5 > minikube-v1.16.0.iso: 136.00 MiB / 212.62 MiB 63.96% 20.64 MiB p/s ETA 3 > minikube-v1.16.0.iso: 144.00 MiB / 212.62 MiB 67.73% 23.61 MiB p/s ETA 2 > minikube-v1.16.0.iso: 168.00 MiB / 212.62 MiB 79.01% 23.61 MiB p/s ETA 1 > minikube-v1.16.0.iso: 176.00 MiB / 212.62 MiB 82.78% 23.61 MiB p/s ETA 1 > minikube-v1.16.0.iso: 200.00 MiB / 212.62 MiB 94.06% 28.11 MiB p/s ETA 0 > minikube-v1.16.0.iso: 212.62 MiB / 212.62 MiB [] 100.00% 56.19 MiB p/s 4s > preloaded-images-k8s-v8-v1....: 4.00 MiB / 902.99 MiB [>__] 0.44% ? p/s ? > preloaded-images-k8s-v8-v1....: 8.00 MiB / 902.99 MiB [>__] 0.89% ? p/s ? > preloaded-images-k8s-v8-v1....: 24.00 MiB / 902.99 MiB [>_] 2.66% ? p/s ? > preloaded-images-k8s-v8-v1....: 32.00 MiB / 902.99 MiB 3.54% 46.67 MiB p > preloaded-images-k8s-v8-v1....: 56.00 MiB / 902.99 MiB 6.
20% 46.67 MiB p > preloaded-images-k8s-v8-v1....: 64.02 MiB / 902.99 MiB 7.09% 46.67 MiB p > preloaded-images-k8s-v8-v1....: 88.00 MiB / 902.99 MiB 9.75% 49.68 MiB p > preloaded-images-k8s-v8-v1....: 104.00 MiB / 902.99 MiB 11.52% 49.68 MiB > preloaded-images-k8s-v8-v1....: 112.00 MiB / 902.99 MiB 12.40% 49.68 MiB > preloaded-images-k8s-v8-v1....: 128.77 MiB / 902.99 MiB 14.26% 50.86 MiB > preloaded-images-k8s-v8-v1....: 144.00 MiB / 902.99 MiB 15.95% 50.86 MiB > preloaded-images-k8s-v8-v1....: 160.00 MiB / 902.99 MiB 17.72% 50.86 MiB > preloaded-images-k8s-v8-v1....: 184.00 MiB / 902.99 MiB 20.38% 53.51 MiB > preloaded-images-k8s-v8-v1....: 192.00 MiB / 902.99 MiB 21.26% 53.51 MiB > preloaded-images-k8s-v8-v1....: 216.00 MiB / 902.99 MiB 23.92% 53.51 MiB > preloaded-images-k8s-v8-v1....: 224.00 MiB / 902.99 MiB 24.81% 54.36 MiB > preloaded-images-k8s-v8-v1....: 240.00 MiB / 902.99 MiB 26.58% 54.36 MiB > preloaded-images-k8s-v8-v1....: 256.00 MiB / 902.99 MiB
28.35% 54.36 MiB > preloaded-images-k8s-v8-v1....: 272.00 MiB / 902.99 MiB 30.12% 56.02 MiB > preloaded-images-k8s-v8-v1....: 280.00 MiB / 902.99 MiB 31.01% 56.02 MiB > preloaded-images-k8s-v8-v1....: 296.00 MiB / 902.99 MiB 32.78% 56.02 MiB > preloaded-images-k8s-v8-v1....: 320.00 MiB / 902.99 MiB 35.44% 57.56 MiB > preloaded-images-k8s-v8-v1....: 336.00 MiB / 902.99 MiB 37.21% 57.56 MiB > preloaded-images-k8s-v8-v1....: 342.49 MiB / 902.99 MiB 37.93% 57.56 MiB > preloaded-images-k8s-v8-v1....: 360.00 MiB / 902.99 MiB 39.87% 58.15 MiB > preloaded-images-k8s-v8-v1....: 362.11 MiB / 902.99 MiB 40.10% 58.15 MiB > preloaded-images-k8s-v8-v1....: 376.00 MiB / 902.99 MiB 41.64% 58.15 MiB > preloaded-images-k8s-v8-v1....: 384.00 MiB / 902.99 MiB 42.53% 56.98 MiB > preloaded-images-k8s-v8-v1....: 408.00 MiB / 902.99 MiB 45.18% 56.98 MiB > preloaded-images-k8s-v8-v1....: 416.00 MiB / 902.99 MiB 46.07% 56.98 MiB > preloaded-images-k8s-v8-v1....: 432.00 MiB / 902.99
MiB 47.84% 58.46 MiB > preloaded-images-k8s-v8-v1....: 448.00 MiB / 902.99 MiB 49.61% 58.46 MiB > preloaded-images-k8s-v8-v1....: 464.00 MiB / 902.99 MiB 51.38% 58.46 MiB > preloaded-images-k8s-v8-v1....: 480.00 MiB / 902.99 MiB 53.16% 59.85 MiB > preloaded-images-k8s-v8-v1....: 488.00 MiB / 902.99 MiB 54.04% 59.85 MiB > preloaded-images-k8s-v8-v1....: 505.07 MiB / 902.99 MiB 55.93% 59.85 MiB > preloaded-images-k8s-v8-v1....: 520.00 MiB / 902.99 MiB 57.59% 60.29 MiB > preloaded-images-k8s-v8-v1....: 528.00 MiB / 902.99 MiB 58.47% 60.29 MiB > preloaded-images-k8s-v8-v1....: 552.00 MiB / 902.99 MiB 61.13% 60.29 MiB > preloaded-images-k8s-v8-v1....: 552.00 MiB / 902.99 MiB 61.13% 59.84 MiB > preloaded-images-k8s-v8-v1....: 576.00 MiB / 902.99 MiB 63.79% 59.84 MiB > preloaded-images-k8s-v8-v1....: 584.00 MiB / 902.99 MiB 64.67% 59.84 MiB > preloaded-images-k8s-v8-v1....: 600.00 MiB / 902.99 MiB 66.45% 61.15 MiB > preloaded-images-k8s-v8-v1....: 600.00 MiB / 902.
99 MiB 66.45% 61.15 MiB > preloaded-images-k8s-v8-v1....: 624.00 MiB / 902.99 MiB 69.10% 61.15 MiB > preloaded-images-k8s-v8-v1....: 624.00 MiB / 902.99 MiB 69.10% 59.78 MiB > preloaded-images-k8s-v8-v1....: 648.00 MiB / 902.99 MiB 71.76% 59.78 MiB > preloaded-images-k8s-v8-v1....: 648.00 MiB / 902.99 MiB 71.76% 59.78 MiB > preloaded-images-k8s-v8-v1....: 660.92 MiB / 902.99 MiB 73.19% 59.89 MiB > preloaded-images-k8s-v8-v1....: 680.00 MiB / 902.99 MiB 75.31% 59.89 MiB > preloaded-images-k8s-v8-v1....: 688.00 MiB / 902.99 MiB 76.19% 59.89 MiB > preloaded-images-k8s-v8-v1....: 712.00 MiB / 902.99 MiB 78.85% 61.51 MiB > preloaded-images-k8s-v8-v1....: 720.00 MiB / 902.99 MiB 79.74% 61.51 MiB > preloaded-images-k8s-v8-v1....: 736.00 MiB / 902.99 MiB 81.51% 61.51 MiB > preloaded-images-k8s-v8-v1....: 752.00 MiB / 902.99 MiB 83.28% 61.85 MiB > preloaded-images-k8s-v8-v1....: 768.00 MiB / 902.99 MiB 85.05% 61.85 MiB > preloaded-images-k8s-v8-v1....: 784.00 MiB / 9
02.99 MiB 86.82% 61.85 MiB > preloaded-images-k8s-v8-v1....: 792.00 MiB / 902.99 MiB 87.71% 62.16 MiB > preloaded-images-k8s-v8-v1....: 808.00 MiB / 902.99 MiB 89.48% 62.16 MiB > preloaded-images-k8s-v8-v1....: 816.00 MiB / 902.99 MiB 90.37% 62.16 MiB > preloaded-images-k8s-v8-v1....: 840.00 MiB / 902.99 MiB 93.02% 63.31 MiB > preloaded-images-k8s-v8-v1....: 846.02 MiB / 902.99 MiB 93.69% 63.31 MiB > preloaded-images-k8s-v8-v1....: 864.00 MiB / 902.99 MiB 95.68% 63.31 MiB > preloaded-images-k8s-v8-v1....: 872.00 MiB / 902.99 MiB 96.57% 62.67 MiB > preloaded-images-k8s-v8-v1....: 888.00 MiB / 902.99 MiB 98.34% 62.67 MiB > preloaded-images-k8s-v8-v1....: 896.00 MiB / 902.99 MiB 99.23% 62.67 MiB > preloaded-images-k8s-v8-v1....: 902.99 MiB / 902.99 MiB 100.00% 69.11 MiE1101 23:33:15.003184 25904 vm_assets.go:127] stat("/home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v8-v1.20.0-containerd-overlay2-amd64.tar.lz4") faile
d: stat /home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v8-v1.20.0-containerd-overlay2-amd64.tar.lz4: no such file or directory
E1101 23:33:15.003574 25904 vm_assets.go:127] stat("/home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v8-v1.20.0-containerd-overlay2-amd64.tar.lz4") failed: stat /home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v8-v1.20.0-containerd-overlay2-amd64.tar.lz4: no such file or directory
> kubeadm.sha256: 64 B / 64 B [--------------------------] 100.00% ? p/s 0s > kubelet.sha256: 64 B / 64 B [--------------------------] 100.00% ? p/s 0s > kubectl.sha256: 64 B / 64 B [--------------------------] 100.00% ? p/s 0s > kubeadm: 4.00 MiB / 37.40 MiB [-->_______________________] 10.69% ? p/s ? > kubectl: 4.00 MiB / 38.37 MiB [-->_______________________] 10.43% ? p/s ? > kubelet: 4.00 MiB / 108.69 MiB [>_________________________] 3.68% ? p/s ? > kubeadm: 24.00 MiB / 37.40 MiB [---------------->________] 64.17% ? p/s ? > kubectl: 8.00 MiB / 38.37 MiB [----->____________________] 20.85% ? p/s ? > kubelet: 32.00 MiB / 108.69 MiB [------->________________] 29.44% ? p/s ? > kubeadm: 37.40 MiB / 37.40 MiB [--------------] 100.00% 108.86 MiB p/s 1s > kubectl: 10.00 MiB / 38.37 MiB [------>__________________] 26.06% ? p/s ? > kubelet: 56.00 MiB / 108.69 MiB [------------>___________] 51.52% ? p/s ? > kubectl: 12.00 MiB / 38.37 MiB [--->________] 31.28% 13.34 Mi
B p/s ETA 1s > kubelet: 78.02 MiB / 108.69 MiB [------->__] 71.78% 123.39 MiB p/s ETA 0s > kubelet: 108.69 MiB / 108.69 MiB [------------] 100.00% 137.12 MiB p/s 1s > kubectl: 14.00 MiB / 38.37 MiB [---->_______] 36.49% 13.34 MiB p/s ETA 1s > kubectl: 20.00 MiB / 38.37 MiB [------>_____] 52.13% 13.34 MiB p/s ETA 1s > kubectl: 32.00 MiB / 38.37 MiB [---------->_] 83.40% 14.63 MiB p/s ETA 0s > kubectl: 32.24 MiB / 38.37 MiB [---------->_] 84.04% 14.63 MiB p/s ETA 0s > kubectl: 38.37 MiB / 38.37 MiB [---------------] 100.00% 27.06 MiB p/s 2s! Enabling 'default-storageclass' returned an error: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
]
! Enabling 'storage-provisioner' returned an error: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error when retrieving current configuration of:
Resource: "/v1, Resource=serviceaccounts", GroupVersionKind: "/v1, Kind=ServiceAccount"
Name: "storage-provisioner", Namespace: "kube-system"
from server for: "/etc/kubernetes/addons/storage-provisioner.yaml": Get "https://localhost:8443/api/v1/namespaces/kube-system/serviceaccounts/storage-provisioner": net/http: TLS handshake timeout
error when retrieving current configuration of:
Resource: "rbac.authorization.k8s.io/v1, Resource=clusterrolebindings", GroupVersionKind: "rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding"
Name: "storage-provisioner", Namespace: ""
from server for: "/etc/kubernetes/addons/storage-provisioner.yaml": Get "https://localhost:8443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/storage-provisioner": net/http: TLS handshake timeout
error when retrieving current configuration of:
Resource: "rbac.authorization.k8s.io/v1, Resource=roles", GroupVersionKind: "rbac.authorization.k8s.io/v1, Kind=Role"
Name: "system:persistent-volume-provisioner", Namespace: "kube-system"
from server for: "/etc/kubernetes/addons/storage-provisioner.yaml": Get "https://localhost:8443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles/system:persistent-volume-provisioner": dial tcp 127.0.0.1:8443: connect: connection refused
error when retrieving current configuration of:
Resource: "rbac.authorization.k8s.io/v1, Resource=rolebindings", GroupVersionKind: "rbac.authorization.k8s.io/v1, Kind=RoleBinding"
Name: "system:persistent-volume-provisioner", Namespace: "kube-system"
from server for: "/etc/kubernetes/addons/storage-provisioner.yaml": Get "https://localhost:8443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings/system:persistent-volume-provisioner": dial tcp 127.0.0.1:8443: connect: connection refused
error when retrieving current configuration of:
Resource: "/v1, Resource=endpoints", GroupVersionKind: "/v1, Kind=Endpoints"
Name: "k8s.io-minikube-hostpath", Namespace: "kube-system"
from server for: "/etc/kubernetes/addons/storage-provisioner.yaml": Get "https://localhost:8443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 127.0.0.1:8443: connect: connection refused
error when retrieving current configuration of:
Resource: "/v1, Resource=pods", GroupVersionKind: "/v1, Kind=Pod"
Name: "storage-provisioner", Namespace: "kube-system"
from server for: "/etc/kubernetes/addons/storage-provisioner.yaml": Get "https://localhost:8443/api/v1/namespaces/kube-system/pods/storage-provisioner": dial tcp 127.0.0.1:8443: connect: connection refused
]
X Problems detected in kubelet:
X Problems detected in kubelet:
X Problems detected in etcd [c5c1b63652414018d04b4e0c2d16ec8b889eb5f5777e075382f27461f6b1ad08]:
X Problems detected in etcd [c5c1b63652414018d04b4e0c2d16ec8b889eb5f5777e075382f27461f6b1ad08]:
X Problems detected in kubelet:
X Problems detected in etcd [c5c1b63652414018d04b4e0c2d16ec8b889eb5f5777e075382f27461f6b1ad08]:
X Exiting due to GUEST_START: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
*
* If the above advice does not help, please let us know:
- https://github.com/kubernetes/minikube/issues/new/choose
** /stderr **
version_upgrade_test.go:190: (dbg) Run: /tmp/minikube-v1.16.0.3804431926.exe start -p stopped-upgrade-233206 --memory=2200 --vm-driver=kvm2 --container-runtime=containerd
=== CONT TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:190: (dbg) Non-zero exit: /tmp/minikube-v1.16.0.3804431926.exe start -p stopped-upgrade-233206 --memory=2200 --vm-driver=kvm2 --container-runtime=containerd: exit status 109 (15m23.242085372s)
-- stdout --
* [stopped-upgrade-233206] minikube v1.16.0 on Ubuntu 20.04
- MINIKUBE_LOCATION=15232
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- KUBECONFIG=/tmp/legacy_kubeconfig3201253827
* Using the kvm2 driver based on existing profile
* Starting control plane node stopped-upgrade-233206 in cluster stopped-upgrade-233206
* Downloading Kubernetes v1.20.0 preload ...
* Updating the running kvm2 "stopped-upgrade-233206" VM ...
* Preparing Kubernetes v1.20.0 on containerd 1.4.3 ...
* Configuring bridge CNI (Container Networking Interface) ...
- Nov 01 23:41:46 stopped-upgrade-233206 kubelet[3024]: E1101 23:41:46.336852 3024 pod_workers.go:191] Error syncing pod f8d3d61ad8d45c80ab92bcedbe7fdb7d ("kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"), skipping: failed to "StartContainer" for "kube-controller-manager" with CrashLoopBackOff: "back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"
- Nov 01 23:41:51 stopped-upgrade-233206 kubelet[3024]: E1101 23:41:51.625626 3024 pod_workers.go:191] Error syncing pod f8d3d61ad8d45c80ab92bcedbe7fdb7d ("kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"), skipping: failed to "StartContainer" for "kube-controller-manager" with CrashLoopBackOff: "back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"
- Nov 01 23:42:39 stopped-upgrade-233206 kubelet[3024]: E1101 23:42:39.561574 3024 pod_workers.go:191] Error syncing pod f8d3d61ad8d45c80ab92bcedbe7fdb7d ("kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"), skipping: failed to "StartContainer" for "kube-controller-manager" with CrashLoopBackOff: "back-off 40s restarting failed container=kube-controller-manager pod=kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"
- Nov 01 23:43:13 stopped-upgrade-233206 kubelet[4357]: E1101 23:43:13.859401 4357 pod_workers.go:191] Error syncing pod f8d3d61ad8d45c80ab92bcedbe7fdb7d ("kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"), skipping: failed to "StartContainer" for "kube-controller-manager" with CrashLoopBackOff: "back-off 10s restarting failed container=kube-controller-manager pod=kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"
- Nov 01 23:43:14 stopped-upgrade-233206 kubelet[4357]: E1101 23:43:14.761504 4357 pod_workers.go:191] Error syncing pod f8d3d61ad8d45c80ab92bcedbe7fdb7d ("kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"), skipping: failed to "StartContainer" for "kube-controller-manager" with CrashLoopBackOff: "back-off 10s restarting failed container=kube-controller-manager pod=kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"
- Generating certificates and keys ...| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K
- Booting up control plane ...- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K|
WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ W
W[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW
[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW
[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K
[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[
K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\
WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K|
WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ W
W[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW
[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW
[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K
[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[
K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\
WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K|
WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ W
W[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW
[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW
[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K
[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[
K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\
WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K|
WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ W
W[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW
[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW
[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K
[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[
K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\
WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K|
WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ W
W[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW
[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW
[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K
[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[
K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\
WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K|
WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ W
W[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW
[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW
[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K
[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K
- Generating certificates and keys ...- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K
- Booting up control plane ...| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K-
WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ W
W[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW
[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW
[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K
[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[
K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/
WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K-
WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ W
W[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW
[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW
[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K
[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[
K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/
WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K-
WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ W
W[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW
[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW
[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K
[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[
K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/
WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K-
WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ W
W[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW
[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW
[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K
[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[
K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/
WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K-
WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ W
W[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW
[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW
[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K
[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[
K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/
WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K/ WW[K[K- WW[K[K\ WW[K[K| WW[K[K
X Problems detected in kubelet:
- Nov 01 23:48:56 stopped-upgrade-233206 kubelet[5270]: E1101 23:48:56.522238 5270 pod_workers.go:191] Error syncing pod f8d3d61ad8d45c80ab92bcedbe7fdb7d ("kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"), skipping: failed to "StartContainer" for "kube-controller-manager" with CrashLoopBackOff: "back-off 10s restarting failed container=kube-controller-manager pod=kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"
- Nov 01 23:48:57 stopped-upgrade-233206 kubelet[5270]: E1101 23:48:57.950640 5270 pod_workers.go:191] Error syncing pod f8d3d61ad8d45c80ab92bcedbe7fdb7d ("kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"), skipping: failed to "StartContainer" for "kube-controller-manager" with CrashLoopBackOff: "back-off 10s restarting failed container=kube-controller-manager pod=kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"
- Nov 01 23:51:05 stopped-upgrade-233206 kubelet[5270]: E1101 23:51:05.652428 5270 pod_workers.go:191] Error syncing pod f8d3d61ad8d45c80ab92bcedbe7fdb7d ("kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"), skipping: failed to "StartContainer" for "kube-controller-manager" with CrashLoopBackOff: "back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-stopped-upgrade-233206_kube-system(f8d3d61ad8d45c80ab92bcedbe7fdb7d)"
-- /stdout --
** stderr **
> preloaded-images-k8s-v8-v1....: 13.81 MiB / 902.99 MiB [>_] 1.53% ? p/s ? > preloaded-images-k8s-v8-v1....: 24.00 MiB / 902.99 MiB [>_] 2.66% ? p/s ? > preloaded-images-k8s-v8-v1....: 40.00 MiB / 902.99 MiB [>_] 4.43% ? p/s ? > preloaded-images-k8s-v8-v1....: 48.00 MiB / 902.99 MiB 5.32% 56.99 MiB p > preloaded-images-k8s-v8-v1....: 64.00 MiB / 902.99 MiB 7.09% 56.99 MiB p > preloaded-images-k8s-v8-v1....: 76.19 MiB / 902.99 MiB 8.44% 56.99 MiB p > preloaded-images-k8s-v8-v1....: 92.88 MiB / 902.99 MiB 10.29% 58.14 MiB > preloaded-images-k8s-v8-v1....: 101.21 MiB / 902.99 MiB 11.21% 58.14 MiB > preloaded-images-k8s-v8-v1....: 114.00 MiB / 902.99 MiB 12.62% 58.14 MiB > preloaded-images-k8s-v8-v1....: 125.21 MiB / 902.99 MiB 13.87% 57.87 MiB > preloaded-images-k8s-v8-v1....: 138.08 MiB / 902.99 MiB 15.29% 57.87 MiB > preloaded-images-k8s-v8-v1....: 163.12 MiB / 902.99 MiB 18.06% 57.87 MiB > preloaded-images-k8s-v8-v1....: 186.00 MiB / 902.99 MiB 20.6
0% 60.67 MiB > preloaded-images-k8s-v8-v1....: 196.00 MiB / 902.99 MiB 21.71% 60.67 MiB > preloaded-images-k8s-v8-v1....: 216.00 MiB / 902.99 MiB 23.92% 60.67 MiB > preloaded-images-k8s-v8-v1....: 228.66 MiB / 902.99 MiB 25.32% 61.34 MiB > preloaded-images-k8s-v8-v1....: 235.93 MiB / 902.99 MiB 26.13% 61.34 MiB > preloaded-images-k8s-v8-v1....: 251.04 MiB / 902.99 MiB 27.80% 61.34 MiB > preloaded-images-k8s-v8-v1....: 256.62 MiB / 902.99 MiB 28.42% 60.39 MiB > preloaded-images-k8s-v8-v1....: 306.22 MiB / 902.99 MiB 33.91% 60.39 MiB > preloaded-images-k8s-v8-v1....: 345.84 MiB / 902.99 MiB 38.30% 60.39 MiB > preloaded-images-k8s-v8-v1....: 387.78 MiB / 902.99 MiB 42.94% 70.60 MiB > preloaded-images-k8s-v8-v1....: 424.00 MiB / 902.99 MiB 46.96% 70.60 MiB > preloaded-images-k8s-v8-v1....: 440.00 MiB / 902.99 MiB 48.73% 70.60 MiB > preloaded-images-k8s-v8-v1....: 456.00 MiB / 902.99 MiB 50.50% 73.38 MiB > preloaded-images-k8s-v8-v1....: 488.00 MiB / 902.99 MiB 5
4.04% 73.38 MiB > preloaded-images-k8s-v8-v1....: 504.00 MiB / 902.99 MiB 55.81% 73.38 MiB > preloaded-images-k8s-v8-v1....: 536.00 MiB / 902.99 MiB 59.36% 77.25 MiB > preloaded-images-k8s-v8-v1....: 560.00 MiB / 902.99 MiB 62.02% 77.25 MiB > preloaded-images-k8s-v8-v1....: 584.00 MiB / 902.99 MiB 64.67% 77.25 MiB > preloaded-images-k8s-v8-v1....: 600.00 MiB / 902.99 MiB 66.45% 79.14 MiB > preloaded-images-k8s-v8-v1....: 624.00 MiB / 902.99 MiB 69.10% 79.14 MiB > preloaded-images-k8s-v8-v1....: 648.00 MiB / 902.99 MiB 71.76% 79.14 MiB > preloaded-images-k8s-v8-v1....: 667.10 MiB / 902.99 MiB 73.88% 81.25 MiB > preloaded-images-k8s-v8-v1....: 688.00 MiB / 902.99 MiB 76.19% 81.25 MiB > preloaded-images-k8s-v8-v1....: 712.00 MiB / 902.99 MiB 78.85% 81.25 MiB > preloaded-images-k8s-v8-v1....: 728.00 MiB / 902.99 MiB 80.62% 82.56 MiB > preloaded-images-k8s-v8-v1....: 745.01 MiB / 902.99 MiB 82.50% 82.56 MiB > preloaded-images-k8s-v8-v1....: 760.00 MiB / 902.99 MiB
84.16% 82.56 MiB > preloaded-images-k8s-v8-v1....: 768.00 MiB / 902.99 MiB 85.05% 81.53 MiB > preloaded-images-k8s-v8-v1....: 793.33 MiB / 902.99 MiB 87.86% 81.53 MiB > preloaded-images-k8s-v8-v1....: 816.00 MiB / 902.99 MiB 90.37% 81.53 MiB > preloaded-images-k8s-v8-v1....: 832.00 MiB / 902.99 MiB 92.14% 83.16 MiB > preloaded-images-k8s-v8-v1....: 856.00 MiB / 902.99 MiB 94.80% 83.16 MiB > preloaded-images-k8s-v8-v1....: 880.00 MiB / 902.99 MiB 97.45% 83.16 MiB > preloaded-images-k8s-v8-v1....: 902.99 MiB / 902.99 MiB 100.00% 100.71 ME1101 23:42:34.886286 31272 vm_assets.go:127] stat("/home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v8-v1.20.0-containerd-overlay2-amd64.tar.lz4") failed: stat /home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v8-v1.20.0-containerd-overlay2-amd64.tar.lz4: no such file or directory
E1101 23:42:34.886642 31272 vm_assets.go:127] stat("/home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v8-v1.20.0-containerd-overlay2-amd64.tar.lz4") failed: stat /home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v8-v1.20.0-containerd-overlay2-amd64.tar.lz4: no such file or directory
X Problems detected in kubelet:
! Unable to restart cluster, will reset it: addons: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml": Process exited with status 1
stdout:
stderr:
error execution phase addon/coredns: unable to create ConfigMap: Post "https://control-plane.minikube.internal:8443/api/v1/namespaces/kube-system/configmaps?timeout=10s": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /run/containerd/containerd.sock logs CONTAINERID'
stderr:
[WARNING
*
X Error starting cluster: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /run/containerd/containerd.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error executi
*
* minikube is exiting due to an error. If the above message is not useful, open an issue:
- https://github.com/kubernetes/minikube/issues/new/choose
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /run/containerd/containerd.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error executi
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Related issue: https://github.com/kubernetes/minikube/issues/4172
** /stderr **
=== CONT TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:190: (dbg) Run: /tmp/minikube-v1.16.0.3804431926.exe start -p stopped-upgrade-233206 --memory=2200 --vm-driver=kvm2 --container-runtime=containerd
E1101 23:57:20.943300 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
=== CONT TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:190: (dbg) Non-zero exit: /tmp/minikube-v1.16.0.3804431926.exe start -p stopped-upgrade-233206 --memory=2200 --vm-driver=kvm2 --container-runtime=containerd: exit status 100 (33.519134616s)
-- stdout --
* [stopped-upgrade-233206] minikube v1.16.0 on Ubuntu 20.04
- MINIKUBE_LOCATION=15232
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- KUBECONFIG=/tmp/legacy_kubeconfig3413139951
* Using the kvm2 driver based on existing profile
* Starting control plane node stopped-upgrade-233206 in cluster stopped-upgrade-233206
* Downloading Kubernetes v1.20.0 preload ...
* Updating the running kvm2 "stopped-upgrade-233206" VM ...
* Preparing Kubernetes v1.20.0 on containerd 1.4.3 ...
-- /stdout --
** stderr **
> preloaded-images-k8s-v8-v1....: 11.69 MiB / 902.99 MiB [>_] 1.29% ? p/s ? > preloaded-images-k8s-v8-v1....: 24.75 MiB / 902.99 MiB [>_] 2.74% ? p/s ? > preloaded-images-k8s-v8-v1....: 34.75 MiB / 902.99 MiB [>_] 3.85% ? p/s ? > preloaded-images-k8s-v8-v1....: 44.75 MiB / 902.99 MiB 4.96% 55.10 MiB p > preloaded-images-k8s-v8-v1....: 57.82 MiB / 902.99 MiB 6.40% 55.10 MiB p > preloaded-images-k8s-v8-v1....: 68.04 MiB / 902.99 MiB 7.54% 55.10 MiB p > preloaded-images-k8s-v8-v1....: 90.02 MiB / 902.99 MiB 9.97% 56.41 MiB p > preloaded-images-k8s-v8-v1....: 121.19 MiB / 902.99 MiB 13.42% 56.41 MiB > preloaded-images-k8s-v8-v1....: 154.02 MiB / 902.99 MiB 17.06% 56.41 MiB > preloaded-images-k8s-v8-v1....: 202.26 MiB / 902.99 MiB 22.40% 64.84 MiB > preloaded-images-k8s-v8-v1....: 240.00 MiB / 902.99 MiB 26.58% 64.84 MiB > preloaded-images-k8s-v8-v1....: 248.00 MiB / 902.99 MiB 27.46% 64.84 MiB > preloaded-images-k8s-v8-v1....: 288.00 MiB / 902.99 MiB 31.8
9% 69.88 MiB > preloaded-images-k8s-v8-v1....: 320.00 MiB / 902.99 MiB 35.44% 69.88 MiB > preloaded-images-k8s-v8-v1....: 360.00 MiB / 902.99 MiB 39.87% 69.88 MiB > preloaded-images-k8s-v8-v1....: 397.80 MiB / 902.99 MiB 44.05% 77.18 MiB > preloaded-images-k8s-v8-v1....: 432.00 MiB / 902.99 MiB 47.84% 77.18 MiB > preloaded-images-k8s-v8-v1....: 456.00 MiB / 902.99 MiB 50.50% 77.18 MiB > preloaded-images-k8s-v8-v1....: 472.00 MiB / 902.99 MiB 52.27% 80.18 MiB > preloaded-images-k8s-v8-v1....: 482.60 MiB / 902.99 MiB 53.44% 80.18 MiB > preloaded-images-k8s-v8-v1....: 512.00 MiB / 902.99 MiB 56.70% 80.18 MiB > preloaded-images-k8s-v8-v1....: 528.68 MiB / 902.99 MiB 58.55% 81.10 MiB > preloaded-images-k8s-v8-v1....: 545.07 MiB / 902.99 MiB 60.36% 81.10 MiB > preloaded-images-k8s-v8-v1....: 568.01 MiB / 902.99 MiB 62.90% 81.10 MiB > preloaded-images-k8s-v8-v1....: 592.00 MiB / 902.99 MiB 65.56% 82.67 MiB > preloaded-images-k8s-v8-v1....: 608.00 MiB / 902.99 MiB 6
7.33% 82.67 MiB > preloaded-images-k8s-v8-v1....: 624.00 MiB / 902.99 MiB 69.10% 82.67 MiB > preloaded-images-k8s-v8-v1....: 648.00 MiB / 902.99 MiB 71.76% 83.36 MiB > preloaded-images-k8s-v8-v1....: 664.00 MiB / 902.99 MiB 73.53% 83.36 MiB > preloaded-images-k8s-v8-v1....: 680.00 MiB / 902.99 MiB 75.31% 83.36 MiB > preloaded-images-k8s-v8-v1....: 696.00 MiB / 902.99 MiB 77.08% 83.14 MiB > preloaded-images-k8s-v8-v1....: 712.00 MiB / 902.99 MiB 78.85% 83.14 MiB > preloaded-images-k8s-v8-v1....: 734.80 MiB / 902.99 MiB 81.37% 83.14 MiB > preloaded-images-k8s-v8-v1....: 744.00 MiB / 902.99 MiB 82.39% 82.94 MiB > preloaded-images-k8s-v8-v1....: 769.37 MiB / 902.99 MiB 85.20% 82.94 MiB > preloaded-images-k8s-v8-v1....: 792.00 MiB / 902.99 MiB 87.71% 82.94 MiB > preloaded-images-k8s-v8-v1....: 809.79 MiB / 902.99 MiB 89.68% 84.67 MiB > preloaded-images-k8s-v8-v1....: 832.00 MiB / 902.99 MiB 92.14% 84.67 MiB > preloaded-images-k8s-v8-v1....: 848.00 MiB / 902.99 MiB
93.91% 84.67 MiB > preloaded-images-k8s-v8-v1....: 872.00 MiB / 902.99 MiB 96.57% 85.89 MiB > preloaded-images-k8s-v8-v1....: 888.00 MiB / 902.99 MiB 98.34% 85.89 MiB > preloaded-images-k8s-v8-v1....: 902.99 MiB / 902.99 MiB 100.00% 111.82 MX Unable to load cached images: loading cached images: containerd load /var/lib/minikube/images/storage-provisioner_v4: ctr images import: sudo ctr -n=k8s.io images import /var/lib/minikube/images/storage-provisioner_v4: Process exited with status 1
stdout:
stderr:
ctr: failed to dial "/run/containerd/containerd.sock": connection error: desc = "transport: error while dialing: dial unix /run/containerd/containerd.sock: connect: connection refused"
X Exiting due to K8S_INSTALL_FAILED: updating control plane: generating kubeadm cfg: getting cgroup driver: get cri info: sudo crictl info: Process exited with status 1
stdout:
stderr:
time="2022-11-01T23:57:54Z" level=fatal msg="getting status of runtime: rpc error: code = Unknown desc = server is not initialized yet"
*
* If the above advice does not help, please let us know:
- https://github.com/kubernetes/minikube/issues/new/choose
** /stderr **
version_upgrade_test.go:196: legacy v1.16.0 start failed: exit status 100
--- FAIL: TestStoppedBinaryUpgrade/Upgrade (1544.15s)
=== RUN TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:71: (dbg) Run: out/minikube-linux-amd64 start -o=json --download-only -p download-only-224514 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=containerd --driver=kvm2 --container-runtime=containerd
aaa_download_only_test.go:71: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-224514 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=containerd --driver=kvm2 --container-runtime=containerd: (26.993603829s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (26.99s)
=== RUN TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)
=== RUN TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:173: (dbg) Run: out/minikube-linux-amd64 logs -p download-only-224514
aaa_download_only_test.go:173: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-224514: exit status 85 (82.28493ms)
-- stdout --
*
* ==> Audit <==
* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
| start | -o=json --download-only | download-only-224514 | jenkins | v1.27.1 | 01 Nov 22 22:45 UTC | |
| | -p download-only-224514 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=containerd | | | | | |
|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
*
* ==> Last Start <==
* Log file created at: 2022/11/01 22:45:14
Running on machine: ubuntu-20-agent-5
Binary: Built with gc go1.19.2 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1101 22:45:14.255062 10684 out.go:296] Setting OutFile to fd 1 ...
I1101 22:45:14.255164 10684 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 22:45:14.255174 10684 out.go:309] Setting ErrFile to fd 2...
I1101 22:45:14.255178 10684 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 22:45:14.255275 10684 root.go:334] Updating PATH: /home/jenkins/minikube-integration/15232-3880/.minikube/bin
W1101 22:45:14.255390 10684 root.go:311] Error reading config file at /home/jenkins/minikube-integration/15232-3880/.minikube/config/config.json: open /home/jenkins/minikube-integration/15232-3880/.minikube/config/config.json: no such file or directory
I1101 22:45:14.255955 10684 out.go:303] Setting JSON to true
I1101 22:45:14.256738 10684 start.go:116] hostinfo: {"hostname":"ubuntu-20-agent-5","uptime":1668,"bootTime":1667341046,"procs":172,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1021-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1101 22:45:14.256800 10684 start.go:126] virtualization: kvm guest
I1101 22:45:14.259727 10684 out.go:97] [download-only-224514] minikube v1.27.1 on Ubuntu 20.04 (kvm/amd64)
I1101 22:45:14.261455 10684 out.go:169] MINIKUBE_LOCATION=15232
W1101 22:45:14.259855 10684 preload.go:295] Failed to list preload files: open /home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball: no such file or directory
I1101 22:45:14.259876 10684 notify.go:220] Checking for updates...
I1101 22:45:14.264363 10684 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1101 22:45:14.266015 10684 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/15232-3880/kubeconfig
I1101 22:45:14.267600 10684 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
I1101 22:45:14.269143 10684 out.go:169] MINIKUBE_BIN=out/minikube-linux-amd64
W1101 22:45:14.271967 10684 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
I1101 22:45:14.272159 10684 driver.go:365] Setting default libvirt URI to qemu:///system
I1101 22:45:14.375694 10684 out.go:97] Using the kvm2 driver based on user configuration
I1101 22:45:14.375716 10684 start.go:282] selected driver: kvm2
I1101 22:45:14.375729 10684 start.go:808] validating driver "kvm2" against <nil>
I1101 22:45:14.375996 10684 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1101 22:45:14.376282 10684 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/15232-3880/.minikube/bin:/home/jenkins/workspace/KVM_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I1101 22:45:14.390948 10684 install.go:137] /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2 version is 1.27.1
I1101 22:45:14.391019 10684 start_flags.go:303] no existing cluster config was found, will generate one from the flags
I1101 22:45:14.391468 10684 start_flags.go:384] Using suggested 6000MB memory alloc based on sys=32101MB, container=0MB
I1101 22:45:14.391613 10684 start_flags.go:870] Wait components to verify : map[apiserver:true system_pods:true]
I1101 22:45:14.391635 10684 cni.go:95] Creating CNI manager for ""
I1101 22:45:14.391644 10684 cni.go:165] "kvm2" driver + containerd runtime found, recommending bridge
I1101 22:45:14.391652 10684 start_flags.go:312] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I1101 22:45:14.391660 10684 start_flags.go:317] config:
{Name:download-only-224514 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-224514 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunt
ime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1101 22:45:14.391850 10684 iso.go:124] acquiring lock: {Name:mk61da6294d889ca01904568b86a25258a195040 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1101 22:45:14.394240 10684 out.go:97] Downloading VM boot image ...
I1101 22:45:14.394295 10684 download.go:101] Downloading: https://storage.googleapis.com/minikube-builds/iso/15232/minikube-v1.27.0-1666976405-15232-amd64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/15232/minikube-v1.27.0-1666976405-15232-amd64.iso.sha256 -> /home/jenkins/minikube-integration/15232-3880/.minikube/cache/iso/amd64/minikube-v1.27.0-1666976405-15232-amd64.iso
I1101 22:45:27.123542 10684 out.go:97] Starting control plane node download-only-224514 in cluster download-only-224514
I1101 22:45:27.123568 10684 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
I1101 22:45:27.280140 10684 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4
I1101 22:45:27.280172 10684 cache.go:57] Caching tarball of preloaded images
I1101 22:45:27.280392 10684 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
I1101 22:45:27.282642 10684 out.go:97] Downloading Kubernetes v1.16.0 preload ...
I1101 22:45:27.282663 10684 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 ...
I1101 22:45:27.431147 10684 download.go:101] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4?checksum=md5:d96a2b2afa188e17db7ddabb58d563fd -> /home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4
I1101 22:45:38.833345 10684 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 ...
I1101 22:45:38.833431 10684 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 ...
*
* The control plane node "" does not exist.
To start a cluster, run: "minikube start -p download-only-224514"
-- /stdout --
aaa_download_only_test.go:174: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.08s)
=== RUN TestDownloadOnly/v1.25.3/json-events
aaa_download_only_test.go:71: (dbg) Run: out/minikube-linux-amd64 start -o=json --download-only -p download-only-224514 --force --alsologtostderr --kubernetes-version=v1.25.3 --container-runtime=containerd --driver=kvm2 --container-runtime=containerd
aaa_download_only_test.go:71: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-224514 --force --alsologtostderr --kubernetes-version=v1.25.3 --container-runtime=containerd --driver=kvm2 --container-runtime=containerd: (19.155545128s)
--- PASS: TestDownloadOnly/v1.25.3/json-events (19.16s)
=== RUN TestDownloadOnly/v1.25.3/preload-exists
--- PASS: TestDownloadOnly/v1.25.3/preload-exists (0.00s)
=== RUN TestDownloadOnly/v1.25.3/LogsDuration
aaa_download_only_test.go:173: (dbg) Run: out/minikube-linux-amd64 logs -p download-only-224514
aaa_download_only_test.go:173: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-224514: exit status 85 (83.68357ms)
-- stdout --
*
* ==> Audit <==
* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
| start | -o=json --download-only | download-only-224514 | jenkins | v1.27.1 | 01 Nov 22 22:45 UTC | |
| | -p download-only-224514 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=containerd | | | | | |
| start | -o=json --download-only | download-only-224514 | jenkins | v1.27.1 | 01 Nov 22 22:45 UTC | |
| | -p download-only-224514 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.25.3 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=containerd | | | | | |
|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
*
* ==> Last Start <==
* Log file created at: 2022/11/01 22:45:41
Running on machine: ubuntu-20-agent-5
Binary: Built with gc go1.19.2 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1101 22:45:41.334384 10724 out.go:296] Setting OutFile to fd 1 ...
I1101 22:45:41.334525 10724 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 22:45:41.334536 10724 out.go:309] Setting ErrFile to fd 2...
I1101 22:45:41.334543 10724 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 22:45:41.334647 10724 root.go:334] Updating PATH: /home/jenkins/minikube-integration/15232-3880/.minikube/bin
W1101 22:45:41.334775 10724 root.go:311] Error reading config file at /home/jenkins/minikube-integration/15232-3880/.minikube/config/config.json: open /home/jenkins/minikube-integration/15232-3880/.minikube/config/config.json: no such file or directory
I1101 22:45:41.335196 10724 out.go:303] Setting JSON to true
I1101 22:45:41.335985 10724 start.go:116] hostinfo: {"hostname":"ubuntu-20-agent-5","uptime":1695,"bootTime":1667341046,"procs":168,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1021-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1101 22:45:41.336045 10724 start.go:126] virtualization: kvm guest
I1101 22:45:41.338627 10724 out.go:97] [download-only-224514] minikube v1.27.1 on Ubuntu 20.04 (kvm/amd64)
I1101 22:45:41.340560 10724 out.go:169] MINIKUBE_LOCATION=15232
I1101 22:45:41.338760 10724 notify.go:220] Checking for updates...
I1101 22:45:41.344060 10724 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1101 22:45:41.345732 10724 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/15232-3880/kubeconfig
I1101 22:45:41.347522 10724 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
I1101 22:45:41.349205 10724 out.go:169] MINIKUBE_BIN=out/minikube-linux-amd64
W1101 22:45:41.352102 10724 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
I1101 22:45:41.352688 10724 config.go:180] Loaded profile config "download-only-224514": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
W1101 22:45:41.352745 10724 start.go:716] api.Load failed for download-only-224514: filestore "download-only-224514": Docker machine "download-only-224514" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
I1101 22:45:41.352818 10724 driver.go:365] Setting default libvirt URI to qemu:///system
W1101 22:45:41.352877 10724 start.go:716] api.Load failed for download-only-224514: filestore "download-only-224514": Docker machine "download-only-224514" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
I1101 22:45:41.383737 10724 out.go:97] Using the kvm2 driver based on existing profile
I1101 22:45:41.383762 10724 start.go:282] selected driver: kvm2
I1101 22:45:41.383772 10724 start.go:808] validating driver "kvm2" against &{Name:download-only-224514 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15232/minikube-v1.27.0-1666976405-15232-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCon
fig:{KubernetesVersion:v1.16.0 ClusterName:download-only-224514 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker B
inaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1101 22:45:41.384102 10724 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1101 22:45:41.384275 10724 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/15232-3880/.minikube/bin:/home/jenkins/workspace/KVM_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I1101 22:45:41.398202 10724 install.go:137] /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2 version is 1.27.1
I1101 22:45:41.398951 10724 cni.go:95] Creating CNI manager for ""
I1101 22:45:41.398967 10724 cni.go:165] "kvm2" driver + containerd runtime found, recommending bridge
I1101 22:45:41.398979 10724 start_flags.go:317] config:
{Name:download-only-224514 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15232/minikube-v1.27.0-1666976405-15232-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.25.3 ClusterName:download-only-224514 Namespace:defa
ult APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwar
ePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1101 22:45:41.399072 10724 iso.go:124] acquiring lock: {Name:mk61da6294d889ca01904568b86a25258a195040 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1101 22:45:41.401171 10724 out.go:97] Starting control plane node download-only-224514 in cluster download-only-224514
I1101 22:45:41.401191 10724 preload.go:132] Checking if preload exists for k8s version v1.25.3 and runtime containerd
I1101 22:45:41.554645 10724 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.25.3/preloaded-images-k8s-v18-v1.25.3-containerd-overlay2-amd64.tar.lz4
I1101 22:45:41.554677 10724 cache.go:57] Caching tarball of preloaded images
I1101 22:45:41.554873 10724 preload.go:132] Checking if preload exists for k8s version v1.25.3 and runtime containerd
I1101 22:45:41.557045 10724 out.go:97] Downloading Kubernetes v1.25.3 preload ...
I1101 22:45:41.557062 10724 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.25.3-containerd-overlay2-amd64.tar.lz4 ...
I1101 22:45:41.703562 10724 download.go:101] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.25.3/preloaded-images-k8s-v18-v1.25.3-containerd-overlay2-amd64.tar.lz4?checksum=md5:60f9fee056da17edf086af60afca6341 -> /home/jenkins/minikube-integration/15232-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.25.3-containerd-overlay2-amd64.tar.lz4
*
* The control plane node "" does not exist.
To start a cluster, run: "minikube start -p download-only-224514"
-- /stdout --
aaa_download_only_test.go:174: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.25.3/LogsDuration (0.08s)
=== RUN TestDownloadOnly/DeleteAll
aaa_download_only_test.go:191: (dbg) Run: out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.18s)
=== RUN TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:203: (dbg) Run: out/minikube-linux-amd64 delete -p download-only-224514
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.16s)
=== RUN TestBinaryMirror
aaa_download_only_test.go:310: (dbg) Run: out/minikube-linux-amd64 start --download-only -p binary-mirror-224601 --alsologtostderr --binary-mirror http://127.0.0.1:38039 --driver=kvm2 --container-runtime=containerd
helpers_test.go:175: Cleaning up "binary-mirror-224601" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p binary-mirror-224601
--- PASS: TestBinaryMirror (1.19s)
=== RUN TestOffline
=== PAUSE TestOffline
=== CONT TestOffline
=== CONT TestOffline
aab_offline_test.go:55: (dbg) Run: out/minikube-linux-amd64 start -p offline-containerd-233107 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=kvm2 --container-runtime=containerd
=== CONT TestOffline
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-amd64 start -p offline-containerd-233107 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=kvm2 --container-runtime=containerd: (1m45.548707149s)
helpers_test.go:175: Cleaning up "offline-containerd-233107" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p offline-containerd-233107
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p offline-containerd-233107: (1.751175696s)
--- PASS: TestOffline (107.30s)
=== RUN TestAddons/Setup
addons_test.go:76: (dbg) Run: out/minikube-linux-amd64 start -p addons-224602 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --driver=kvm2 --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=helm-tiller
addons_test.go:76: (dbg) Done: out/minikube-linux-amd64 start -p addons-224602 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --driver=kvm2 --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=helm-tiller: (3m42.834801692s)
--- PASS: TestAddons/Setup (222.83s)
=== RUN TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry
=== CONT TestAddons/parallel/Registry
=== CONT TestAddons/parallel/Registry
addons_test.go:283: registry stabilized in 17.960834ms
=== CONT TestAddons/parallel/Registry
addons_test.go:285: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:342: "registry-44pmx" [b7d5a04c-c0f6-466c-b3ec-5019e4d6e183] Running
=== CONT TestAddons/parallel/Registry
addons_test.go:285: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.016668081s
addons_test.go:288: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
=== CONT TestAddons/parallel/Registry
helpers_test.go:342: "registry-proxy-5rvkt" [2339eae4-6da1-4bb6-bf0b-ce8e9cad3102] Running
=== CONT TestAddons/parallel/Registry
addons_test.go:288: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.01132401s
addons_test.go:293: (dbg) Run: kubectl --context addons-224602 delete po -l run=registry-test --now
addons_test.go:298: (dbg) Run: kubectl --context addons-224602 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
=== CONT TestAddons/parallel/Registry
addons_test.go:298: (dbg) Done: kubectl --context addons-224602 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (7.68869973s)
addons_test.go:312: (dbg) Run: out/minikube-linux-amd64 -p addons-224602 ip
=== CONT TestAddons/parallel/Registry
addons_test.go:341: (dbg) Run: out/minikube-linux-amd64 -p addons-224602 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (18.59s)
=== RUN TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress
=== CONT TestAddons/parallel/Ingress
addons_test.go:165: (dbg) Run: kubectl --context addons-224602 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
=== CONT TestAddons/parallel/Ingress
addons_test.go:185: (dbg) Run: kubectl --context addons-224602 replace --force -f testdata/nginx-ingress-v1.yaml
2022/11/01 22:50:03 [DEBUG] GET http://192.168.39.18:5000
=== CONT TestAddons/parallel/Ingress
addons_test.go:185: (dbg) Done: kubectl --context addons-224602 replace --force -f testdata/nginx-ingress-v1.yaml: (1.068654874s)
addons_test.go:198: (dbg) Run: kubectl --context addons-224602 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:203: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:342: "nginx" [570b853a-e079-4cbe-b1b8-fc9cc8af4ad4] Pending
helpers_test.go:342: "nginx" [570b853a-e079-4cbe-b1b8-fc9cc8af4ad4] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
=== CONT TestAddons/parallel/Ingress
helpers_test.go:342: "nginx" [570b853a-e079-4cbe-b1b8-fc9cc8af4ad4] Running
=== CONT TestAddons/parallel/Ingress
addons_test.go:203: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 12.013905872s
addons_test.go:215: (dbg) Run: out/minikube-linux-amd64 -p addons-224602 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:239: (dbg) Run: kubectl --context addons-224602 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:244: (dbg) Run: out/minikube-linux-amd64 -p addons-224602 ip
addons_test.go:250: (dbg) Run: nslookup hello-john.test 192.168.39.18
addons_test.go:259: (dbg) Run: out/minikube-linux-amd64 -p addons-224602 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:259: (dbg) Done: out/minikube-linux-amd64 -p addons-224602 addons disable ingress-dns --alsologtostderr -v=1: (1.019255637s)
addons_test.go:264: (dbg) Run: out/minikube-linux-amd64 -p addons-224602 addons disable ingress --alsologtostderr -v=1
=== CONT TestAddons/parallel/Ingress
addons_test.go:264: (dbg) Done: out/minikube-linux-amd64 -p addons-224602 addons disable ingress --alsologtostderr -v=1: (7.650712014s)
--- PASS: TestAddons/parallel/Ingress (22.94s)
=== RUN TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer
=== CONT TestAddons/parallel/MetricsServer
=== CONT TestAddons/parallel/MetricsServer
addons_test.go:360: metrics-server stabilized in 17.953882ms
=== CONT TestAddons/parallel/MetricsServer
addons_test.go:362: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
=== CONT TestAddons/parallel/MetricsServer
helpers_test.go:342: "metrics-server-769cd898cd-d2vn9" [b75607bd-034e-43ba-82d0-532a93008842] Running
=== CONT TestAddons/parallel/MetricsServer
addons_test.go:362: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.020307861s
addons_test.go:368: (dbg) Run: kubectl --context addons-224602 top pods -n kube-system
=== CONT TestAddons/parallel/MetricsServer
addons_test.go:385: (dbg) Run: out/minikube-linux-amd64 -p addons-224602 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.78s)
=== RUN TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller
=== CONT TestAddons/parallel/HelmTiller
addons_test.go:409: tiller-deploy stabilized in 2.43296ms
addons_test.go:411: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...
helpers_test.go:342: "tiller-deploy-696b5bfbb7-9fmwv" [55bba2ee-53f1-4744-9983-7808076c334c] Running
=== CONT TestAddons/parallel/HelmTiller
addons_test.go:411: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.009228035s
addons_test.go:426: (dbg) Run: kubectl --context addons-224602 run --rm helm-test --restart=Never --image=alpine/helm:2.16.3 -it --namespace=kube-system -- version
=== CONT TestAddons/parallel/HelmTiller
addons_test.go:426: (dbg) Done: kubectl --context addons-224602 run --rm helm-test --restart=Never --image=alpine/helm:2.16.3 -it --namespace=kube-system -- version: (11.785913568s)
addons_test.go:443: (dbg) Run: out/minikube-linux-amd64 -p addons-224602 addons disable helm-tiller --alsologtostderr -v=1
--- PASS: TestAddons/parallel/HelmTiller (17.26s)
=== RUN TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI
=== CONT TestAddons/parallel/CSI
=== CONT TestAddons/parallel/CSI
addons_test.go:514: csi-hostpath-driver pods stabilized in 34.347711ms
addons_test.go:517: (dbg) Run: kubectl --context addons-224602 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:522: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:392: (dbg) Run: kubectl --context addons-224602 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:527: (dbg) Run: kubectl --context addons-224602 create -f testdata/csi-hostpath-driver/pv-pod.yaml
=== CONT TestAddons/parallel/CSI
addons_test.go:532: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:342: "task-pv-pod" [af132c9e-4499-4cd3-b029-9237b72ceb88] Pending
=== CONT TestAddons/parallel/CSI
helpers_test.go:342: "task-pv-pod" [af132c9e-4499-4cd3-b029-9237b72ceb88] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
=== CONT TestAddons/parallel/CSI
helpers_test.go:342: "task-pv-pod" [af132c9e-4499-4cd3-b029-9237b72ceb88] Running
=== CONT TestAddons/parallel/CSI
addons_test.go:532: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 19.024393544s
addons_test.go:537: (dbg) Run: kubectl --context addons-224602 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:542: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:417: (dbg) Run: kubectl --context addons-224602 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:425: TestAddons/parallel/CSI: WARNING: volume snapshot get for "default" "new-snapshot-demo" returned:
helpers_test.go:417: (dbg) Run: kubectl --context addons-224602 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:547: (dbg) Run: kubectl --context addons-224602 delete pod task-pv-pod
addons_test.go:553: (dbg) Run: kubectl --context addons-224602 delete pvc hpvc
addons_test.go:559: (dbg) Run: kubectl --context addons-224602 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:564: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:392: (dbg) Run: kubectl --context addons-224602 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
=== CONT TestAddons/parallel/CSI
helpers_test.go:392: (dbg) Run: kubectl --context addons-224602 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:569: (dbg) Run: kubectl --context addons-224602 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:574: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:342: "task-pv-pod-restore" [802c5f13-ce82-4749-8ffe-416494e90d71] Pending
helpers_test.go:342: "task-pv-pod-restore" [802c5f13-ce82-4749-8ffe-416494e90d71] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
=== CONT TestAddons/parallel/CSI
helpers_test.go:342: "task-pv-pod-restore" [802c5f13-ce82-4749-8ffe-416494e90d71] Running
=== CONT TestAddons/parallel/CSI
addons_test.go:574: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 12.022090371s
addons_test.go:579: (dbg) Run: kubectl --context addons-224602 delete pod task-pv-pod-restore
addons_test.go:579: (dbg) Done: kubectl --context addons-224602 delete pod task-pv-pod-restore: (1.190244983s)
addons_test.go:583: (dbg) Run: kubectl --context addons-224602 delete pvc hpvc-restore
addons_test.go:587: (dbg) Run: kubectl --context addons-224602 delete volumesnapshot new-snapshot-demo
addons_test.go:591: (dbg) Run: out/minikube-linux-amd64 -p addons-224602 addons disable csi-hostpath-driver --alsologtostderr -v=1
=== CONT TestAddons/parallel/CSI
addons_test.go:591: (dbg) Done: out/minikube-linux-amd64 -p addons-224602 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.930384431s)
addons_test.go:595: (dbg) Run: out/minikube-linux-amd64 -p addons-224602 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (44.82s)
=== RUN TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp
=== CONT TestAddons/parallel/Headlamp
=== CONT TestAddons/parallel/Headlamp
addons_test.go:738: (dbg) Run: out/minikube-linux-amd64 addons enable headlamp -p addons-224602 --alsologtostderr -v=1
=== CONT TestAddons/parallel/Headlamp
addons_test.go:738: (dbg) Done: out/minikube-linux-amd64 addons enable headlamp -p addons-224602 --alsologtostderr -v=1: (1.159266425s)
addons_test.go:743: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:342: "headlamp-5f4cf474d8-zg7sf" [1c516d18-a387-4c6e-9da4-fa179d94944c] Pending
=== CONT TestAddons/parallel/Headlamp
helpers_test.go:342: "headlamp-5f4cf474d8-zg7sf" [1c516d18-a387-4c6e-9da4-fa179d94944c] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
=== CONT TestAddons/parallel/Headlamp
helpers_test.go:342: "headlamp-5f4cf474d8-zg7sf" [1c516d18-a387-4c6e-9da4-fa179d94944c] Running
=== CONT TestAddons/parallel/Headlamp
addons_test.go:743: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 11.009769384s
--- PASS: TestAddons/parallel/Headlamp (12.17s)
=== RUN TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner
=== CONT TestAddons/parallel/CloudSpanner
addons_test.go:759: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:342: "cloud-spanner-emulator-6c47ff8fb6-gwqn8" [19ec8676-3999-4639-a269-da33d0b717d2] Running
=== CONT TestAddons/parallel/CloudSpanner
addons_test.go:759: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.007807448s
addons_test.go:762: (dbg) Run: out/minikube-linux-amd64 addons disable cloud-spanner -p addons-224602
--- PASS: TestAddons/parallel/CloudSpanner (5.49s)
=== RUN TestAddons/serial/GCPAuth
addons_test.go:606: (dbg) Run: kubectl --context addons-224602 create -f testdata/busybox.yaml
addons_test.go:613: (dbg) Run: kubectl --context addons-224602 create sa gcp-auth-test
addons_test.go:619: (dbg) TestAddons/serial/GCPAuth: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:342: "busybox" [3528694d-0111-47be-b128-8c5c9d7b8f71] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:342: "busybox" [3528694d-0111-47be-b128-8c5c9d7b8f71] Running
addons_test.go:619: (dbg) TestAddons/serial/GCPAuth: integration-test=busybox healthy within 9.008472076s
addons_test.go:625: (dbg) Run: kubectl --context addons-224602 exec busybox -- /bin/sh -c "printenv GOOGLE_APPLICATION_CREDENTIALS"
addons_test.go:637: (dbg) Run: kubectl --context addons-224602 describe sa gcp-auth-test
addons_test.go:675: (dbg) Run: kubectl --context addons-224602 exec busybox -- /bin/sh -c "printenv GOOGLE_CLOUD_PROJECT"
addons_test.go:688: (dbg) Run: out/minikube-linux-amd64 -p addons-224602 addons disable gcp-auth --alsologtostderr -v=1
addons_test.go:688: (dbg) Done: out/minikube-linux-amd64 -p addons-224602 addons disable gcp-auth --alsologtostderr -v=1: (6.085420217s)
addons_test.go:704: (dbg) Run: out/minikube-linux-amd64 -p addons-224602 addons enable gcp-auth
addons_test.go:704: (dbg) Done: out/minikube-linux-amd64 -p addons-224602 addons enable gcp-auth: (2.047639518s)
addons_test.go:710: (dbg) Run: kubectl --context addons-224602 apply -f testdata/private-image.yaml
addons_test.go:717: (dbg) TestAddons/serial/GCPAuth: waiting 8m0s for pods matching "integration-test=private-image" in namespace "default" ...
helpers_test.go:342: "private-image-5c86c669bd-q6jzz" [ac7b7aa1-d76b-43fb-908a-5bb6dfe59396] Pending / Ready:ContainersNotReady (containers with unready status: [private-image]) / ContainersReady:ContainersNotReady (containers with unready status: [private-image])
helpers_test.go:342: "private-image-5c86c669bd-q6jzz" [ac7b7aa1-d76b-43fb-908a-5bb6dfe59396] Running
addons_test.go:717: (dbg) TestAddons/serial/GCPAuth: integration-test=private-image healthy within 20.008004087s
addons_test.go:723: (dbg) Run: kubectl --context addons-224602 apply -f testdata/private-image-eu.yaml
addons_test.go:728: (dbg) TestAddons/serial/GCPAuth: waiting 8m0s for pods matching "integration-test=private-image-eu" in namespace "default" ...
helpers_test.go:342: "private-image-eu-64c96f687b-rngxj" [6e9c77c5-c9b8-4e7d-9b94-da487f74ba9c] Pending / Ready:ContainersNotReady (containers with unready status: [private-image-eu]) / ContainersReady:ContainersNotReady (containers with unready status: [private-image-eu])
helpers_test.go:342: "private-image-eu-64c96f687b-rngxj" [6e9c77c5-c9b8-4e7d-9b94-da487f74ba9c] Running
addons_test.go:728: (dbg) TestAddons/serial/GCPAuth: integration-test=private-image-eu healthy within 11.009658683s
--- PASS: TestAddons/serial/GCPAuth (49.72s)
=== RUN TestAddons/StoppedEnableDisable
addons_test.go:135: (dbg) Run: out/minikube-linux-amd64 stop -p addons-224602
addons_test.go:135: (dbg) Done: out/minikube-linux-amd64 stop -p addons-224602: (1m32.37420541s)
addons_test.go:139: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p addons-224602
addons_test.go:143: (dbg) Run: out/minikube-linux-amd64 addons disable dashboard -p addons-224602
--- PASS: TestAddons/StoppedEnableDisable (92.59s)
=== RUN TestCertOptions
=== PAUSE TestCertOptions
=== CONT TestCertOptions
cert_options_test.go:49: (dbg) Run: out/minikube-linux-amd64 start -p cert-options-233721 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=kvm2 --container-runtime=containerd
=== CONT TestCertOptions
cert_options_test.go:49: (dbg) Done: out/minikube-linux-amd64 start -p cert-options-233721 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=kvm2 --container-runtime=containerd: (1m6.061104532s)
cert_options_test.go:60: (dbg) Run: out/minikube-linux-amd64 -p cert-options-233721 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run: kubectl --context cert-options-233721 config view
cert_options_test.go:100: (dbg) Run: out/minikube-linux-amd64 ssh -p cert-options-233721 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-233721" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p cert-options-233721
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-options-233721: (1.286791914s)
--- PASS: TestCertOptions (68.04s)
=== RUN TestCertExpiration
=== PAUSE TestCertExpiration
=== CONT TestCertExpiration
cert_options_test.go:123: (dbg) Run: out/minikube-linux-amd64 start -p cert-expiration-233533 --memory=2048 --cert-expiration=3m --driver=kvm2 --container-runtime=containerd
=== CONT TestCertExpiration
cert_options_test.go:123: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-233533 --memory=2048 --cert-expiration=3m --driver=kvm2 --container-runtime=containerd: (1m4.078820905s)
=== CONT TestCertExpiration
cert_options_test.go:131: (dbg) Run: out/minikube-linux-amd64 start -p cert-expiration-233533 --memory=2048 --cert-expiration=8760h --driver=kvm2 --container-runtime=containerd
E1101 23:39:45.145526 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
=== CONT TestCertExpiration
cert_options_test.go:131: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-233533 --memory=2048 --cert-expiration=8760h --driver=kvm2 --container-runtime=containerd: (50.873334024s)
helpers_test.go:175: Cleaning up "cert-expiration-233533" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p cert-expiration-233533
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-expiration-233533: (1.216983875s)
--- PASS: TestCertExpiration (296.17s)
=== RUN TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag
=== CONT TestForceSystemdFlag
docker_test.go:85: (dbg) Run: out/minikube-linux-amd64 start -p force-systemd-flag-233550 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=kvm2 --container-runtime=containerd
=== CONT TestForceSystemdFlag
docker_test.go:85: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-flag-233550 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=kvm2 --container-runtime=containerd: (1m20.843445663s)
docker_test.go:115: (dbg) Run: out/minikube-linux-amd64 -p force-systemd-flag-233550 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-flag-233550" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p force-systemd-flag-233550
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-flag-233550: (1.12924205s)
--- PASS: TestForceSystemdFlag (82.23s)
=== RUN TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv
=== CONT TestForceSystemdEnv
=== CONT TestForceSystemdEnv
docker_test.go:149: (dbg) Run: out/minikube-linux-amd64 start -p force-systemd-env-233107 --memory=2048 --alsologtostderr -v=5 --driver=kvm2 --container-runtime=containerd
=== CONT TestForceSystemdEnv
docker_test.go:149: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-env-233107 --memory=2048 --alsologtostderr -v=5 --driver=kvm2 --container-runtime=containerd: (56.355786352s)
docker_test.go:115: (dbg) Run: out/minikube-linux-amd64 -p force-systemd-env-233107 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-env-233107" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p force-systemd-env-233107
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-env-233107: (1.915298088s)
--- PASS: TestForceSystemdEnv (58.52s)
=== RUN TestKVMDriverInstallOrUpdate
=== PAUSE TestKVMDriverInstallOrUpdate
=== CONT TestKVMDriverInstallOrUpdate
E1101 23:37:12.337595 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
--- PASS: TestKVMDriverInstallOrUpdate (8.91s)
=== RUN TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run: out/minikube-linux-amd64 start -p nospam-225253 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-225253 --driver=kvm2 --container-runtime=containerd
error_spam_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -p nospam-225253 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-225253 --driver=kvm2 --container-runtime=containerd: (53.363962161s)
--- PASS: TestErrorSpam/setup (53.36s)
=== RUN TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 start --dry-run
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 start --dry-run
error_spam_test.go:182: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 start --dry-run
--- PASS: TestErrorSpam/start (0.41s)
=== RUN TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 status
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 status
error_spam_test.go:182: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 status
--- PASS: TestErrorSpam/status (0.79s)
=== RUN TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 pause
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 pause
error_spam_test.go:182: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 pause
--- PASS: TestErrorSpam/pause (1.43s)
=== RUN TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 unpause
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 unpause
error_spam_test.go:182: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 unpause
--- PASS: TestErrorSpam/unpause (1.60s)
=== RUN TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 stop: (1.318416683s)
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 stop
error_spam_test.go:182: (dbg) Run: out/minikube-linux-amd64 -p nospam-225253 --log_dir /tmp/nospam-225253 stop
--- PASS: TestErrorSpam/stop (1.50s)
=== RUN TestFunctional/serial/CopySyncFile
functional_test.go:1782: local sync path: /home/jenkins/minikube-integration/15232-3880/.minikube/files/etc/test/nested/copy/10671/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)
=== RUN TestFunctional/serial/StartWithProxy
functional_test.go:2161: (dbg) Run: out/minikube-linux-amd64 start -p functional-225352 --memory=4000 --apiserver-port=8441 --wait=all --driver=kvm2 --container-runtime=containerd
E1101 22:54:45.145450 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 22:54:45.152082 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 22:54:45.162316 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 22:54:45.182555 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 22:54:45.222795 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 22:54:45.303167 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 22:54:45.463634 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 22:54:45.784490 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 22:54:46.425528 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 22:54:47.705743 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 22:54:50.267531 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 22:54:55.388075 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
functional_test.go:2161: (dbg) Done: out/minikube-linux-amd64 start -p functional-225352 --memory=4000 --apiserver-port=8441 --wait=all --driver=kvm2 --container-runtime=containerd: (1m10.679322982s)
--- PASS: TestFunctional/serial/StartWithProxy (70.68s)
=== RUN TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)
=== RUN TestFunctional/serial/SoftStart
functional_test.go:652: (dbg) Run: out/minikube-linux-amd64 start -p functional-225352 --alsologtostderr -v=8
E1101 22:55:05.628362 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 22:55:26.109328 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
functional_test.go:652: (dbg) Done: out/minikube-linux-amd64 start -p functional-225352 --alsologtostderr -v=8: (25.552134293s)
functional_test.go:656: soft start took 25.552787972s for "functional-225352" cluster.
--- PASS: TestFunctional/serial/SoftStart (25.55s)
=== RUN TestFunctional/serial/KubeContext
functional_test.go:674: (dbg) Run: kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.04s)
=== RUN TestFunctional/serial/KubectlGetPods
functional_test.go:689: (dbg) Run: kubectl --context functional-225352 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.10s)
=== RUN TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1042: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 cache add k8s.gcr.io/pause:3.1
functional_test.go:1042: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 cache add k8s.gcr.io/pause:3.1: (4.787388281s)
functional_test.go:1042: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 cache add k8s.gcr.io/pause:3.3
functional_test.go:1042: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 cache add k8s.gcr.io/pause:3.3: (5.017885525s)
functional_test.go:1042: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 cache add k8s.gcr.io/pause:latest
functional_test.go:1042: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 cache add k8s.gcr.io/pause:latest: (4.828730096s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (14.63s)
=== RUN TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1070: (dbg) Run: docker build -t minikube-local-cache-test:functional-225352 /tmp/TestFunctionalserialCacheCmdcacheadd_local2133248298/001
functional_test.go:1082: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 cache add minikube-local-cache-test:functional-225352
functional_test.go:1082: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 cache add minikube-local-cache-test:functional-225352: (3.114626694s)
functional_test.go:1087: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 cache delete minikube-local-cache-test:functional-225352
functional_test.go:1076: (dbg) Run: docker rmi minikube-local-cache-test:functional-225352
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (3.35s)
=== RUN TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3
functional_test.go:1095: (dbg) Run: out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3 (0.07s)
=== RUN TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1103: (dbg) Run: out/minikube-linux-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.07s)
=== RUN TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1117: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.24s)
=== RUN TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1140: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh sudo crictl rmi k8s.gcr.io/pause:latest
functional_test.go:1146: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh sudo crictl inspecti k8s.gcr.io/pause:latest
functional_test.go:1146: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-225352 ssh sudo crictl inspecti k8s.gcr.io/pause:latest: exit status 1 (234.213195ms)
-- stdout --
[31mFATA[0m[0000] no such image "k8s.gcr.io/pause:latest" present
-- /stdout --
** stderr **
ssh: Process exited with status 1
** /stderr **
functional_test.go:1151: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 cache reload
functional_test.go:1151: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 cache reload: (3.621532244s)
functional_test.go:1156: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh sudo crictl inspecti k8s.gcr.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (4.34s)
=== RUN TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1165: (dbg) Run: out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:3.1
functional_test.go:1165: (dbg) Run: out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.13s)
=== RUN TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:709: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 kubectl -- --context functional-225352 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.13s)
=== RUN TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:734: (dbg) Run: out/kubectl --context functional-225352 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.12s)
=== RUN TestFunctional/serial/ExtraConfig
functional_test.go:750: (dbg) Run: out/minikube-linux-amd64 start -p functional-225352 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E1101 22:56:07.070120 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
functional_test.go:750: (dbg) Done: out/minikube-linux-amd64 start -p functional-225352 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (33.04786435s)
functional_test.go:754: restart took 33.047973761s for "functional-225352" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (33.05s)
=== RUN TestFunctional/serial/ComponentHealth
functional_test.go:803: (dbg) Run: kubectl --context functional-225352 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:818: etcd phase: Running
functional_test.go:828: etcd status: Ready
functional_test.go:818: kube-apiserver phase: Running
functional_test.go:828: kube-apiserver status: Ready
functional_test.go:818: kube-controller-manager phase: Running
functional_test.go:828: kube-controller-manager status: Ready
functional_test.go:818: kube-scheduler phase: Running
functional_test.go:828: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.06s)
=== RUN TestFunctional/serial/LogsCmd
functional_test.go:1229: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 logs
functional_test.go:1229: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 logs: (1.351980027s)
--- PASS: TestFunctional/serial/LogsCmd (1.35s)
=== RUN TestFunctional/serial/LogsFileCmd
functional_test.go:1243: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 logs --file /tmp/TestFunctionalserialLogsFileCmd3335213972/001/logs.txt
functional_test.go:1243: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 logs --file /tmp/TestFunctionalserialLogsFileCmd3335213972/001/logs.txt: (1.377729029s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.38s)
=== RUN TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd
=== CONT TestFunctional/parallel/ConfigCmd
=== CONT TestFunctional/parallel/ConfigCmd
functional_test.go:1192: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 config unset cpus
=== CONT TestFunctional/parallel/ConfigCmd
functional_test.go:1192: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 config get cpus
=== CONT TestFunctional/parallel/ConfigCmd
functional_test.go:1192: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-225352 config get cpus: exit status 14 (81.333261ms)
** stderr **
Error: specified key could not be found in config
** /stderr **
functional_test.go:1192: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 config set cpus 2
=== CONT TestFunctional/parallel/ConfigCmd
functional_test.go:1192: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 config get cpus
functional_test.go:1192: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 config unset cpus
=== CONT TestFunctional/parallel/ConfigCmd
functional_test.go:1192: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 config get cpus
=== CONT TestFunctional/parallel/ConfigCmd
functional_test.go:1192: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-225352 config get cpus: exit status 14 (75.808033ms)
** stderr **
Error: specified key could not be found in config
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.49s)
=== RUN TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd
=== CONT TestFunctional/parallel/DashboardCmd
functional_test.go:898: (dbg) daemon: [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-225352 --alsologtostderr -v=1]
=== CONT TestFunctional/parallel/DashboardCmd
functional_test.go:903: (dbg) stopping [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-225352 --alsologtostderr -v=1] ...
helpers_test.go:506: unable to kill pid 15741: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (29.33s)
=== RUN TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun
=== CONT TestFunctional/parallel/DryRun
functional_test.go:967: (dbg) Run: out/minikube-linux-amd64 start -p functional-225352 --dry-run --memory 250MB --alsologtostderr --driver=kvm2 --container-runtime=containerd
functional_test.go:967: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-225352 --dry-run --memory 250MB --alsologtostderr --driver=kvm2 --container-runtime=containerd: exit status 23 (168.599481ms)
-- stdout --
* [functional-225352] minikube v1.27.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=15232
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/15232-3880/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
* Using the kvm2 driver based on existing profile
-- /stdout --
** stderr **
I1101 22:56:50.483612 15650 out.go:296] Setting OutFile to fd 1 ...
I1101 22:56:50.483756 15650 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 22:56:50.483768 15650 out.go:309] Setting ErrFile to fd 2...
I1101 22:56:50.483776 15650 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 22:56:50.483885 15650 root.go:334] Updating PATH: /home/jenkins/minikube-integration/15232-3880/.minikube/bin
I1101 22:56:50.484460 15650 out.go:303] Setting JSON to false
I1101 22:56:50.485464 15650 start.go:116] hostinfo: {"hostname":"ubuntu-20-agent-5","uptime":2365,"bootTime":1667341046,"procs":259,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1021-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1101 22:56:50.485547 15650 start.go:126] virtualization: kvm guest
I1101 22:56:50.487825 15650 out.go:177] * [functional-225352] minikube v1.27.1 on Ubuntu 20.04 (kvm/amd64)
I1101 22:56:50.491387 15650 out.go:177] - MINIKUBE_LOCATION=15232
I1101 22:56:50.491339 15650 notify.go:220] Checking for updates...
I1101 22:56:50.494686 15650 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1101 22:56:50.496221 15650 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/15232-3880/kubeconfig
I1101 22:56:50.497708 15650 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
I1101 22:56:50.499024 15650 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I1101 22:56:50.501010 15650 config.go:180] Loaded profile config "functional-225352": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.25.3
I1101 22:56:50.501358 15650 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 22:56:50.501415 15650 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 22:56:50.519227 15650 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:40121
I1101 22:56:50.519608 15650 main.go:134] libmachine: () Calling .GetVersion
I1101 22:56:50.520127 15650 main.go:134] libmachine: Using API Version 1
I1101 22:56:50.520154 15650 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 22:56:50.520470 15650 main.go:134] libmachine: () Calling .GetMachineName
I1101 22:56:50.520626 15650 main.go:134] libmachine: (functional-225352) Calling .DriverName
I1101 22:56:50.520803 15650 driver.go:365] Setting default libvirt URI to qemu:///system
I1101 22:56:50.521081 15650 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 22:56:50.521111 15650 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 22:56:50.536859 15650 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:36861
I1101 22:56:50.537223 15650 main.go:134] libmachine: () Calling .GetVersion
I1101 22:56:50.537657 15650 main.go:134] libmachine: Using API Version 1
I1101 22:56:50.537681 15650 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 22:56:50.538000 15650 main.go:134] libmachine: () Calling .GetMachineName
I1101 22:56:50.538183 15650 main.go:134] libmachine: (functional-225352) Calling .DriverName
I1101 22:56:50.571181 15650 out.go:177] * Using the kvm2 driver based on existing profile
I1101 22:56:50.572557 15650 start.go:282] selected driver: kvm2
I1101 22:56:50.572583 15650 start.go:808] validating driver "kvm2" against &{Name:functional-225352 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15232/minikube-v1.27.0-1666976405-15232-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.25.3 ClusterName:functional-225352 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.39.203 Port:8441 KubernetesVersion:v1.25.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics
-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1101 22:56:50.572703 15650 start.go:819] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1101 22:56:50.575262 15650 out.go:177]
W1101 22:56:50.576753 15650 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
I1101 22:56:50.578044 15650 out.go:177]
** /stderr **
functional_test.go:984: (dbg) Run: out/minikube-linux-amd64 start -p functional-225352 --dry-run --alsologtostderr -v=1 --driver=kvm2 --container-runtime=containerd
--- PASS: TestFunctional/parallel/DryRun (0.33s)
=== RUN TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage
=== CONT TestFunctional/parallel/InternationalLanguage
functional_test.go:1013: (dbg) Run: out/minikube-linux-amd64 start -p functional-225352 --dry-run --memory 250MB --alsologtostderr --driver=kvm2 --container-runtime=containerd
functional_test.go:1013: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-225352 --dry-run --memory 250MB --alsologtostderr --driver=kvm2 --container-runtime=containerd: exit status 23 (166.550783ms)
-- stdout --
* [functional-225352] minikube v1.27.1 sur Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=15232
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/15232-3880/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
* Utilisation du pilote kvm2 basé sur le profil existant
-- /stdout --
** stderr **
I1101 22:56:47.176355 15292 out.go:296] Setting OutFile to fd 1 ...
I1101 22:56:47.176575 15292 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 22:56:47.176589 15292 out.go:309] Setting ErrFile to fd 2...
I1101 22:56:47.176598 15292 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 22:56:47.176820 15292 root.go:334] Updating PATH: /home/jenkins/minikube-integration/15232-3880/.minikube/bin
I1101 22:56:47.177533 15292 out.go:303] Setting JSON to false
I1101 22:56:47.178721 15292 start.go:116] hostinfo: {"hostname":"ubuntu-20-agent-5","uptime":2361,"bootTime":1667341046,"procs":236,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1021-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1101 22:56:47.178786 15292 start.go:126] virtualization: kvm guest
I1101 22:56:47.180902 15292 out.go:177] * [functional-225352] minikube v1.27.1 sur Ubuntu 20.04 (kvm/amd64)
I1101 22:56:47.182454 15292 notify.go:220] Checking for updates...
I1101 22:56:47.182470 15292 out.go:177] - MINIKUBE_LOCATION=15232
I1101 22:56:47.184125 15292 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1101 22:56:47.186184 15292 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/15232-3880/kubeconfig
I1101 22:56:47.187704 15292 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
I1101 22:56:47.189440 15292 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I1101 22:56:47.191435 15292 config.go:180] Loaded profile config "functional-225352": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.25.3
I1101 22:56:47.191808 15292 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 22:56:47.191880 15292 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 22:56:47.207634 15292 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:36323
I1101 22:56:47.208037 15292 main.go:134] libmachine: () Calling .GetVersion
I1101 22:56:47.208638 15292 main.go:134] libmachine: Using API Version 1
I1101 22:56:47.208663 15292 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 22:56:47.209017 15292 main.go:134] libmachine: () Calling .GetMachineName
I1101 22:56:47.209211 15292 main.go:134] libmachine: (functional-225352) Calling .DriverName
I1101 22:56:47.209410 15292 driver.go:365] Setting default libvirt URI to qemu:///system
I1101 22:56:47.209709 15292 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 22:56:47.209752 15292 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 22:56:47.224722 15292 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:46595
I1101 22:56:47.225137 15292 main.go:134] libmachine: () Calling .GetVersion
I1101 22:56:47.225609 15292 main.go:134] libmachine: Using API Version 1
I1101 22:56:47.225640 15292 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 22:56:47.225930 15292 main.go:134] libmachine: () Calling .GetMachineName
I1101 22:56:47.226116 15292 main.go:134] libmachine: (functional-225352) Calling .DriverName
I1101 22:56:47.258356 15292 out.go:177] * Utilisation du pilote kvm2 basé sur le profil existant
I1101 22:56:47.259744 15292 start.go:282] selected driver: kvm2
I1101 22:56:47.259769 15292 start.go:808] validating driver "kvm2" against &{Name:functional-225352 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15232/minikube-v1.27.0-1666976405-15232-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.35-1666722858-15219@sha256:8debc1b6a335075c5f99bfbf131b4f5566f68c6500dc5991817832e55fcc9456 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.25.3 ClusterName:functional-225352 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.39.203 Port:8441 KubernetesVersion:v1.25.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics
-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
I1101 22:56:47.259941 15292 start.go:819] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1101 22:56:47.262494 15292 out.go:177]
W1101 22:56:47.264059 15292 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
I1101 22:56:47.265713 15292 out.go:177]
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.17s)
=== RUN TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd
=== CONT TestFunctional/parallel/StatusCmd
functional_test.go:847: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 status
functional_test.go:853: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
=== CONT TestFunctional/parallel/StatusCmd
functional_test.go:865: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (0.89s)
=== RUN TestFunctional/parallel/ServiceCmd
=== PAUSE TestFunctional/parallel/ServiceCmd
=== CONT TestFunctional/parallel/ServiceCmd
functional_test.go:1433: (dbg) Run: kubectl --context functional-225352 create deployment hello-node --image=k8s.gcr.io/echoserver:1.8
functional_test.go:1439: (dbg) Run: kubectl --context functional-225352 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1444: (dbg) TestFunctional/parallel/ServiceCmd: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:342: "hello-node-5fcdfb5cc4-lftcd" [242eefda-4e3f-45b3-a789-f7a58c3afc40] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])
=== CONT TestFunctional/parallel/ServiceCmd
helpers_test.go:342: "hello-node-5fcdfb5cc4-lftcd" [242eefda-4e3f-45b3-a789-f7a58c3afc40] Running
=== CONT TestFunctional/parallel/ServiceCmd
functional_test.go:1444: (dbg) TestFunctional/parallel/ServiceCmd: app=hello-node healthy within 13.012302526s
functional_test.go:1449: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 service list
=== CONT TestFunctional/parallel/ServiceCmd
functional_test.go:1463: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 service --namespace=default --https --url hello-node
functional_test.go:1476: found endpoint: https://192.168.39.203:30572
functional_test.go:1491: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 service hello-node --url --format={{.IP}}
functional_test.go:1505: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 service hello-node --url
=== CONT TestFunctional/parallel/ServiceCmd
functional_test.go:1511: found endpoint for hello-node: http://192.168.39.203:30572
--- PASS: TestFunctional/parallel/ServiceCmd (14.74s)
=== RUN TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect
=== CONT TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1559: (dbg) Run: kubectl --context functional-225352 create deployment hello-node-connect --image=k8s.gcr.io/echoserver:1.8
=== CONT TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1565: (dbg) Run: kubectl --context functional-225352 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1570: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:342: "hello-node-connect-6458c8fb6f-7r9jg" [c19925df-034c-4772-bee8-b0a630dedb43] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])
=== CONT TestFunctional/parallel/ServiceCmdConnect
helpers_test.go:342: "hello-node-connect-6458c8fb6f-7r9jg" [c19925df-034c-4772-bee8-b0a630dedb43] Running
=== CONT TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1570: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 12.01688712s
functional_test.go:1579: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 service hello-node-connect --url
functional_test.go:1585: found endpoint for hello-node-connect: http://192.168.39.203:32612
functional_test.go:1605: http://192.168.39.203:32612: success! body:
Hostname: hello-node-connect-6458c8fb6f-7r9jg
Pod Information:
-no pod information available-
Server values:
server_version=nginx: 1.13.3 - lua: 10008
Request Information:
client_address=10.244.0.1
method=GET
real path=/
query=
request_version=1.1
request_uri=http://192.168.39.203:8080/
Request Headers:
accept-encoding=gzip
host=192.168.39.203:32612
user-agent=Go-http-client/1.1
Request Body:
-no body in request-
--- PASS: TestFunctional/parallel/ServiceCmdConnect (12.53s)
=== RUN TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd
=== CONT TestFunctional/parallel/AddonsCmd
functional_test.go:1620: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 addons list
functional_test.go:1632: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.17s)
=== RUN TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim
=== CONT TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:342: "storage-provisioner" [34baa257-f8ed-458b-8f70-65ae97e78056] Running
=== CONT TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.015579373s
functional_test_pvc_test.go:49: (dbg) Run: kubectl --context functional-225352 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run: kubectl --context functional-225352 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run: kubectl --context functional-225352 get pvc myclaim -o=json
=== CONT TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:76: (dbg) Run: kubectl --context functional-225352 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run: kubectl --context functional-225352 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:342: "sp-pod" [a1c275ce-573b-4987-b6df-3b43826fae8e] Pending
=== CONT TestFunctional/parallel/PersistentVolumeClaim
helpers_test.go:342: "sp-pod" [a1c275ce-573b-4987-b6df-3b43826fae8e] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
=== CONT TestFunctional/parallel/PersistentVolumeClaim
helpers_test.go:342: "sp-pod" [a1c275ce-573b-4987-b6df-3b43826fae8e] Running
=== CONT TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 17.010899351s
functional_test_pvc_test.go:100: (dbg) Run: kubectl --context functional-225352 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run: kubectl --context functional-225352 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-225352 delete -f testdata/storage-provisioner/pod.yaml: (1.994237171s)
functional_test_pvc_test.go:125: (dbg) Run: kubectl --context functional-225352 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:342: "sp-pod" [6afcd953-b5c9-4257-9e20-f98ff2ee963e] Pending
helpers_test.go:342: "sp-pod" [6afcd953-b5c9-4257-9e20-f98ff2ee963e] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
=== CONT TestFunctional/parallel/PersistentVolumeClaim
helpers_test.go:342: "sp-pod" [6afcd953-b5c9-4257-9e20-f98ff2ee963e] Running
2022/11/01 22:57:19 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
=== CONT TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 27.008376548s
functional_test_pvc_test.go:114: (dbg) Run: kubectl --context functional-225352 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (54.22s)
=== RUN TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd
=== CONT TestFunctional/parallel/SSHCmd
functional_test.go:1655: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "echo hello"
=== CONT TestFunctional/parallel/SSHCmd
functional_test.go:1672: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.47s)
=== RUN TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd
=== CONT TestFunctional/parallel/CpCmd
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh -n functional-225352 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 cp functional-225352:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd3983111284/001/cp-test.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh -n functional-225352 "sudo cat /home/docker/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.09s)
=== RUN TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL
=== CONT TestFunctional/parallel/MySQL
functional_test.go:1720: (dbg) Run: kubectl --context functional-225352 replace --force -f testdata/mysql.yaml
functional_test.go:1726: (dbg) TestFunctional/parallel/MySQL: waiting 10m0s for pods matching "app=mysql" in namespace "default" ...
=== CONT TestFunctional/parallel/MySQL
helpers_test.go:342: "mysql-596b7fcdbf-mvxd4" [ec024527-913d-4796-a259-eea13aa2b4df] Pending / Ready:ContainersNotReady (containers with unready status: [mysql]) / ContainersReady:ContainersNotReady (containers with unready status: [mysql])
=== CONT TestFunctional/parallel/MySQL
helpers_test.go:342: "mysql-596b7fcdbf-mvxd4" [ec024527-913d-4796-a259-eea13aa2b4df] Running
=== CONT TestFunctional/parallel/MySQL
functional_test.go:1726: (dbg) TestFunctional/parallel/MySQL: app=mysql healthy within 24.008734465s
functional_test.go:1734: (dbg) Run: kubectl --context functional-225352 exec mysql-596b7fcdbf-mvxd4 -- mysql -ppassword -e "show databases;"
=== CONT TestFunctional/parallel/MySQL
functional_test.go:1734: (dbg) Non-zero exit: kubectl --context functional-225352 exec mysql-596b7fcdbf-mvxd4 -- mysql -ppassword -e "show databases;": exit status 1 (265.589857ms)
** stderr **
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
command terminated with exit code 1
** /stderr **
=== CONT TestFunctional/parallel/MySQL
functional_test.go:1734: (dbg) Run: kubectl --context functional-225352 exec mysql-596b7fcdbf-mvxd4 -- mysql -ppassword -e "show databases;"
=== CONT TestFunctional/parallel/MySQL
functional_test.go:1734: (dbg) Non-zero exit: kubectl --context functional-225352 exec mysql-596b7fcdbf-mvxd4 -- mysql -ppassword -e "show databases;": exit status 1 (161.814754ms)
** stderr **
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
command terminated with exit code 1
** /stderr **
=== CONT TestFunctional/parallel/MySQL
functional_test.go:1734: (dbg) Run: kubectl --context functional-225352 exec mysql-596b7fcdbf-mvxd4 -- mysql -ppassword -e "show databases;"
functional_test.go:1734: (dbg) Non-zero exit: kubectl --context functional-225352 exec mysql-596b7fcdbf-mvxd4 -- mysql -ppassword -e "show databases;": exit status 1 (158.188719ms)
** stderr **
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
command terminated with exit code 1
** /stderr **
=== CONT TestFunctional/parallel/MySQL
functional_test.go:1734: (dbg) Run: kubectl --context functional-225352 exec mysql-596b7fcdbf-mvxd4 -- mysql -ppassword -e "show databases;"
=== CONT TestFunctional/parallel/MySQL
functional_test.go:1734: (dbg) Non-zero exit: kubectl --context functional-225352 exec mysql-596b7fcdbf-mvxd4 -- mysql -ppassword -e "show databases;": exit status 1 (141.668118ms)
** stderr **
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
command terminated with exit code 1
** /stderr **
=== CONT TestFunctional/parallel/MySQL
functional_test.go:1734: (dbg) Run: kubectl --context functional-225352 exec mysql-596b7fcdbf-mvxd4 -- mysql -ppassword -e "show databases;"
--- PASS: TestFunctional/parallel/MySQL (32.84s)
=== RUN TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync
=== CONT TestFunctional/parallel/FileSync
functional_test.go:1856: Checking for existence of /etc/test/nested/copy/10671/hosts within VM
functional_test.go:1858: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "sudo cat /etc/test/nested/copy/10671/hosts"
=== CONT TestFunctional/parallel/FileSync
functional_test.go:1863: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.34s)
=== RUN TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync
=== CONT TestFunctional/parallel/CertSync
functional_test.go:1899: Checking for existence of /etc/ssl/certs/10671.pem within VM
functional_test.go:1900: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "sudo cat /etc/ssl/certs/10671.pem"
=== CONT TestFunctional/parallel/CertSync
functional_test.go:1899: Checking for existence of /usr/share/ca-certificates/10671.pem within VM
functional_test.go:1900: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "sudo cat /usr/share/ca-certificates/10671.pem"
=== CONT TestFunctional/parallel/CertSync
functional_test.go:1899: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1900: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "sudo cat /etc/ssl/certs/51391683.0"
=== CONT TestFunctional/parallel/CertSync
functional_test.go:1926: Checking for existence of /etc/ssl/certs/106712.pem within VM
functional_test.go:1927: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "sudo cat /etc/ssl/certs/106712.pem"
=== CONT TestFunctional/parallel/CertSync
functional_test.go:1926: Checking for existence of /usr/share/ca-certificates/106712.pem within VM
functional_test.go:1927: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "sudo cat /usr/share/ca-certificates/106712.pem"
=== CONT TestFunctional/parallel/CertSync
functional_test.go:1926: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1927: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (1.49s)
=== RUN TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels
=== CONT TestFunctional/parallel/NodeLabels
functional_test.go:215: (dbg) Run: kubectl --context functional-225352 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.08s)
=== RUN TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled
=== CONT TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:1954: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "sudo systemctl is-active docker"
=== CONT TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:1954: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-225352 ssh "sudo systemctl is-active docker": exit status 1 (236.307752ms)
-- stdout --
inactive
-- /stdout --
** stderr **
ssh: Process exited with status 3
** /stderr **
functional_test.go:1954: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "sudo systemctl is-active crio"
functional_test.go:1954: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-225352 ssh "sudo systemctl is-active crio": exit status 1 (294.114262ms)
-- stdout --
inactive
-- /stdout --
** stderr **
ssh: Process exited with status 3
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.53s)
=== RUN TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License
=== CONT TestFunctional/parallel/License
functional_test.go:2215: (dbg) Run: out/minikube-linux-amd64 license
--- PASS: TestFunctional/parallel/License (0.52s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort
=== CONT TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:257: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image ls --format short
functional_test.go:262: (dbg) Stdout: out/minikube-linux-amd64 -p functional-225352 image ls --format short:
registry.k8s.io/pause:3.8
registry.k8s.io/kube-scheduler:v1.25.3
registry.k8s.io/kube-proxy:v1.25.3
registry.k8s.io/kube-controller-manager:v1.25.3
registry.k8s.io/kube-apiserver:v1.25.3
registry.k8s.io/etcd:3.5.4-0
registry.k8s.io/coredns/coredns:v1.9.3
k8s.gcr.io/pause:latest
k8s.gcr.io/pause:3.3
k8s.gcr.io/pause:3.1
k8s.gcr.io/echoserver:1.8
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
gcr.io/google-containers/addon-resizer:functional-225352
docker.io/library/nginx:latest
docker.io/library/mysql:5.7
docker.io/library/minikube-local-cache-test:functional-225352
docker.io/kindest/kindnetd:v20221004-44d545d1
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.27s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable
=== CONT TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:257: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image ls --format table
functional_test.go:262: (dbg) Stdout: out/minikube-linux-amd64 -p functional-225352 image ls --format table:
|---------------------------------------------|--------------------|---------------|--------|
| Image | Tag | Image ID | Size |
|---------------------------------------------|--------------------|---------------|--------|
| registry.k8s.io/coredns/coredns | v1.9.3 | sha256:5185b9 | 14.8MB |
| gcr.io/google-containers/addon-resizer | functional-225352 | sha256:ffd4cf | 10.8MB |
| gcr.io/k8s-minikube/storage-provisioner | v5 | sha256:6e38f4 | 9.06MB |
| gcr.io/k8s-minikube/busybox | 1.28.4-glibc | sha256:56cc51 | 2.4MB |
| k8s.gcr.io/pause | 3.1 | sha256:da86e6 | 315kB |
| k8s.gcr.io/pause | 3.3 | sha256:0184c1 | 298kB |
| localhost/my-image | functional-225352 | sha256:33635f | 775kB |
| registry.k8s.io/kube-scheduler | v1.25.3 | sha256:6d23ec | 15.8MB |
| docker.io/library/minikube-local-cache-test | functional-225352 | sha256:6f284a | 1.74kB |
| docker.io/library/nginx | latest | sha256:76c69f | 56.8MB |
| docker.io/library/mysql | 5.7 | sha256:149052 | 144MB |
| registry.k8s.io/etcd | 3.5.4-0 | sha256:a8a176 | 102MB |
| registry.k8s.io/kube-apiserver | v1.25.3 | sha256:0346db | 34.2MB |
| registry.k8s.io/kube-controller-manager | v1.25.3 | sha256:603999 | 31.3MB |
| docker.io/kindest/kindnetd | v20221004-44d545d1 | sha256:d6e3e2 | 25.8MB |
| registry.k8s.io/kube-proxy | v1.25.3 | sha256:beaaf0 | 20.3MB |
| registry.k8s.io/pause | 3.8 | sha256:487387 | 311kB |
| k8s.gcr.io/echoserver | 1.8 | sha256:82e4c8 | 46.2MB |
| k8s.gcr.io/pause | latest | sha256:350b16 | 72.3kB |
|---------------------------------------------|--------------------|---------------|--------|
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.25s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson
=== CONT TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:257: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image ls --format json
=== CONT TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:262: (dbg) Stdout: out/minikube-linux-amd64 -p functional-225352 image ls --format json:
[{"id":"sha256:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"9058936"},{"id":"sha256:82e4c8a736a4fcf22b5ef9f6a4ff6207064c7187d7694bf97bd561605a538410","repoDigests":["k8s.gcr.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969"],"repoTags":["k8s.gcr.io/echoserver:1.8"],"size":"46237695"},{"id":"sha256:33635f131c030d33f2ea87f68c16f2cb846ecd50588acd5ddf5ee5d0517deff5","repoDigests":[],"repoTags":["localhost/my-image:functional-225352"],"size":"775254"},{"id":"sha256:5185b96f0becf59032b8e3646e99f84d9655dff3ac9e2605e0dc77f9c441ae4a","repoDigests":["registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a"],"repoTags":["registry.k8s.io/coredns/coredns:v1.9.3"],"size":"14837849"},{"id":"sha256:a8a176a5d5d698f9409dc2
46f81fa69d37d4a2f4132ba5e62e72a78476b27f66","repoDigests":["registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1"],"repoTags":["registry.k8s.io/etcd:3.5.4-0"],"size":"102157811"},{"id":"sha256:07655ddf2eebe5d250f7a72c25f638b27126805d61779741b4e62e69ba080558","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93"],"repoTags":[],"size":"75788960"},{"id":"sha256:6f284a170b5771acdd7aeef9132fac36d74ff31b6d6a23e2f0e665279008bf7d","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-225352"],"size":"1737"},{"id":"sha256:76c69feac34e85768b284f84416c3546b240e8cb4f68acbbe5ad261a8b36f39f","repoDigests":["docker.io/library/nginx@sha256:943c25b4b66b332184d5ba6bb18234273551593016c0e0ae906bab111548239f"],"repoTags":["docker.io/library/nginx:latest"],"size":"56841090"},{"id":"sha256:56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c","repoDigests":["gcr.io/k8s-minikube/busyb
ox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"2395207"},{"id":"sha256:60399923127581086e9029f30a0c9e3c88708efa8fc05d22d5e33887e7c0310a","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:d3a06262256f3e7578d5f77df137a8cdf58f9f498f35b5b56d116e8a7e31dc91"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.25.3"],"size":"31261869"},{"id":"sha256:4873874c08efc72e9729683a83ffbb7502ee729e9a5ac097723806ea7fa13517","repoDigests":["registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d"],"repoTags":["registry.k8s.io/pause:3.8"],"size":"311286"},{"id":"sha256:ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91","repoDigests":[],"repoTags":["gcr.io/google-containers/addon-resizer:functional-225352"],"size":"10823156"},{"id":"sha256:da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e","repoDigests":[],"repoTags":["k8s.gcr.io/pause:3.1"],"size":"31
5399"},{"id":"sha256:0346dbd74bcb9485bb4da1b33027094d79488470d8d1b9baa4d927db564e4fe0","repoDigests":["registry.k8s.io/kube-apiserver@sha256:4188262a351f156e8027ff81693d771c35b34b668cbd61e59c4a4490dd5c08f3"],"repoTags":["registry.k8s.io/kube-apiserver:v1.25.3"],"size":"34238163"},{"id":"sha256:beaaf00edd38a6cb405376588e708084376a6786e722231dc8a1482730e0c041","repoDigests":["registry.k8s.io/kube-proxy@sha256:6bf25f038543e1f433cb7f2bdda445ed348c7b9279935ebc2ae4f432308ed82f"],"repoTags":["registry.k8s.io/kube-proxy:v1.25.3"],"size":"20265805"},{"id":"sha256:d6e3e26021b60c625f0ef5b2dd3f9e22d2d398e05bccc4fdd7d59fbbb6a04d3f","repoDigests":["docker.io/kindest/kindnetd@sha256:273469d84ede51824194a31f6a405e3d3686b8b87cd161ea40f6bc3ff8e04ffe"],"repoTags":["docker.io/kindest/kindnetd:v20221004-44d545d1"],"size":"25830582"},{"id":"sha256:14905234a4ed471d6da5b7e09d9e9f62f4d350713e2b0e8c86652ebcbf710238","repoDigests":["docker.io/library/mysql@sha256:f5e2d4d7dccdc3f2a1d592bd3f0eb472b2f72f9fb942a84ff5b5cc049fe63a04"],"repoT
ags":["docker.io/library/mysql:5.7"],"size":"144343859"},{"id":"sha256:0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da","repoDigests":[],"repoTags":["k8s.gcr.io/pause:3.3"],"size":"297686"},{"id":"sha256:350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06","repoDigests":[],"repoTags":["k8s.gcr.io/pause:latest"],"size":"72306"},{"id":"sha256:6d23ec0e8b87eaaa698c3425c2c4d25f7329c587e9b39d967ab3f60048983912","repoDigests":["registry.k8s.io/kube-scheduler@sha256:f478aa916568b00269068ff1e9ff742ecc16192eb6e371e30f69f75df904162e"],"repoTags":["registry.k8s.io/kube-scheduler:v1.25.3"],"size":"15798744"}]
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.30s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml
=== CONT TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:257: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image ls --format yaml
functional_test.go:262: (dbg) Stdout: out/minikube-linux-amd64 -p functional-225352 image ls --format yaml:
- id: sha256:d6e3e26021b60c625f0ef5b2dd3f9e22d2d398e05bccc4fdd7d59fbbb6a04d3f
repoDigests:
- docker.io/kindest/kindnetd@sha256:273469d84ede51824194a31f6a405e3d3686b8b87cd161ea40f6bc3ff8e04ffe
repoTags:
- docker.io/kindest/kindnetd:v20221004-44d545d1
size: "25830582"
- id: sha256:ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91
repoDigests: []
repoTags:
- gcr.io/google-containers/addon-resizer:functional-225352
size: "10823156"
- id: sha256:5185b96f0becf59032b8e3646e99f84d9655dff3ac9e2605e0dc77f9c441ae4a
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a
repoTags:
- registry.k8s.io/coredns/coredns:v1.9.3
size: "14837849"
- id: sha256:a8a176a5d5d698f9409dc246f81fa69d37d4a2f4132ba5e62e72a78476b27f66
repoDigests:
- registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1
repoTags:
- registry.k8s.io/etcd:3.5.4-0
size: "102157811"
- id: sha256:0346dbd74bcb9485bb4da1b33027094d79488470d8d1b9baa4d927db564e4fe0
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:4188262a351f156e8027ff81693d771c35b34b668cbd61e59c4a4490dd5c08f3
repoTags:
- registry.k8s.io/kube-apiserver:v1.25.3
size: "34238163"
- id: sha256:6d23ec0e8b87eaaa698c3425c2c4d25f7329c587e9b39d967ab3f60048983912
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:f478aa916568b00269068ff1e9ff742ecc16192eb6e371e30f69f75df904162e
repoTags:
- registry.k8s.io/kube-scheduler:v1.25.3
size: "15798744"
- id: sha256:07655ddf2eebe5d250f7a72c25f638b27126805d61779741b4e62e69ba080558
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
repoTags: []
size: "75788960"
- id: sha256:350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06
repoDigests: []
repoTags:
- k8s.gcr.io/pause:latest
size: "72306"
- id: sha256:60399923127581086e9029f30a0c9e3c88708efa8fc05d22d5e33887e7c0310a
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:d3a06262256f3e7578d5f77df137a8cdf58f9f498f35b5b56d116e8a7e31dc91
repoTags:
- registry.k8s.io/kube-controller-manager:v1.25.3
size: "31261869"
- id: sha256:4873874c08efc72e9729683a83ffbb7502ee729e9a5ac097723806ea7fa13517
repoDigests:
- registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d
repoTags:
- registry.k8s.io/pause:3.8
size: "311286"
- id: sha256:0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da
repoDigests: []
repoTags:
- k8s.gcr.io/pause:3.3
size: "297686"
- id: sha256:6f284a170b5771acdd7aeef9132fac36d74ff31b6d6a23e2f0e665279008bf7d
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-225352
size: "1737"
- id: sha256:14905234a4ed471d6da5b7e09d9e9f62f4d350713e2b0e8c86652ebcbf710238
repoDigests:
- docker.io/library/mysql@sha256:f5e2d4d7dccdc3f2a1d592bd3f0eb472b2f72f9fb942a84ff5b5cc049fe63a04
repoTags:
- docker.io/library/mysql:5.7
size: "144343859"
- id: sha256:76c69feac34e85768b284f84416c3546b240e8cb4f68acbbe5ad261a8b36f39f
repoDigests:
- docker.io/library/nginx@sha256:943c25b4b66b332184d5ba6bb18234273551593016c0e0ae906bab111548239f
repoTags:
- docker.io/library/nginx:latest
size: "56841090"
- id: sha256:56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "2395207"
- id: sha256:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "9058936"
- id: sha256:82e4c8a736a4fcf22b5ef9f6a4ff6207064c7187d7694bf97bd561605a538410
repoDigests:
- k8s.gcr.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969
repoTags:
- k8s.gcr.io/echoserver:1.8
size: "46237695"
- id: sha256:da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e
repoDigests: []
repoTags:
- k8s.gcr.io/pause:3.1
size: "315399"
- id: sha256:beaaf00edd38a6cb405376588e708084376a6786e722231dc8a1482730e0c041
repoDigests:
- registry.k8s.io/kube-proxy@sha256:6bf25f038543e1f433cb7f2bdda445ed348c7b9279935ebc2ae4f432308ed82f
repoTags:
- registry.k8s.io/kube-proxy:v1.25.3
size: "20265805"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.25s)
=== RUN TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild
=== CONT TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:304: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh pgrep buildkitd
=== CONT TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:304: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-225352 ssh pgrep buildkitd: exit status 1 (233.720127ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
functional_test.go:311: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image build -t localhost/my-image:functional-225352 testdata/build
=== CONT TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:311: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 image build -t localhost/my-image:functional-225352 testdata/build: (2.826994001s)
functional_test.go:319: (dbg) Stderr: out/minikube-linux-amd64 -p functional-225352 image build -t localhost/my-image:functional-225352 testdata/build:
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 97B done
#1 DONE 0.1s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.1s
#3 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#3 DONE 0.7s
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.1s
#5 [1/3] FROM gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.1s done
#5 sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa 0B / 772.79kB 0.2s
#5 extracting sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa 0.1s done
#5 DONE 0.4s
#6 [2/3] RUN true
#6 DONE 0.8s
#7 [3/3] ADD content.txt /
#7 DONE 0.1s
#8 exporting to image
#8 exporting layers
#8 exporting layers 0.2s done
#8 exporting manifest sha256:3d757dce1296aaca400519b37492effec990692d87822aa5a01505557b09a11f 0.0s done
#8 exporting config sha256:33635f131c030d33f2ea87f68c16f2cb846ecd50588acd5ddf5ee5d0517deff5 0.0s done
#8 naming to localhost/my-image:functional-225352 done
#8 DONE 0.2s
functional_test.go:444: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (3.30s)
=== RUN TestFunctional/parallel/ImageCommands/Setup
=== CONT TestFunctional/parallel/ImageCommands/Setup
functional_test.go:338: (dbg) Run: docker pull gcr.io/google-containers/addon-resizer:1.8.8
=== CONT TestFunctional/parallel/ImageCommands/Setup
functional_test.go:338: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (2.056541244s)
functional_test.go:343: (dbg) Run: docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-225352
--- PASS: TestFunctional/parallel/ImageCommands/Setup (2.08s)
=== RUN TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes
=== CONT TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2046: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.11s)
=== RUN TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== CONT TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2046: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.11s)
=== RUN TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters
=== CONT TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2046: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.11s)
=== RUN TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1266: (dbg) Run: out/minikube-linux-amd64 profile lis
=== CONT TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1271: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.39s)
=== RUN TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1306: (dbg) Run: out/minikube-linux-amd64 profile list
=== CONT TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1311: Took "249.475219ms" to run "out/minikube-linux-amd64 profile list"
functional_test.go:1320: (dbg) Run: out/minikube-linux-amd64 profile list -l
functional_test.go:1325: Took "68.843039ms" to run "out/minikube-linux-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.32s)
=== RUN TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1357: (dbg) Run: out/minikube-linux-amd64 profile list -o json
=== CONT TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1362: Took "261.738911ms" to run "out/minikube-linux-amd64 profile list -o json"
functional_test.go:1370: (dbg) Run: out/minikube-linux-amd64 profile list -o json --light
=== CONT TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1375: Took "81.191773ms" to run "out/minikube-linux-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.34s)
=== RUN TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:351: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image load --daemon gcr.io/google-containers/addon-resizer:functional-225352
=== CONT TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:351: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 image load --daemon gcr.io/google-containers/addon-resizer:functional-225352: (3.916046657s)
functional_test.go:444: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.15s)
=== RUN TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:361: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image load --daemon gcr.io/google-containers/addon-resizer:functional-225352
=== CONT TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:361: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 image load --daemon gcr.io/google-containers/addon-resizer:functional-225352: (3.864311929s)
functional_test.go:444: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (4.09s)
=== RUN TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:231: (dbg) Run: docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:231: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (1.402832284s)
functional_test.go:236: (dbg) Run: docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-225352
functional_test.go:241: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image load --daemon gcr.io/google-containers/addon-resizer:functional-225352
=== CONT TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:241: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 image load --daemon gcr.io/google-containers/addon-resizer:functional-225352: (4.527713034s)
functional_test.go:444: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (6.30s)
=== RUN TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:376: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image save gcr.io/google-containers/addon-resizer:functional-225352 /home/jenkins/workspace/KVM_Linux_containerd_integration/addon-resizer-save.tar
=== CONT TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:376: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 image save gcr.io/google-containers/addon-resizer:functional-225352 /home/jenkins/workspace/KVM_Linux_containerd_integration/addon-resizer-save.tar: (1.021093337s)
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.02s)
=== RUN TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:388: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image rm gcr.io/google-containers/addon-resizer:functional-225352
=== CONT TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:444: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (1.07s)
=== RUN TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short
=== CONT TestFunctional/parallel/Version/short
functional_test.go:2183: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 version --short
--- PASS: TestFunctional/parallel/Version/short (0.07s)
=== RUN TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components
=== CONT TestFunctional/parallel/Version/components
functional_test.go:2197: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.79s)
=== RUN TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:405: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image load /home/jenkins/workspace/KVM_Linux_containerd_integration/addon-resizer-save.tar
=== CONT TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:405: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 image load /home/jenkins/workspace/KVM_Linux_containerd_integration/addon-resizer-save.tar: (1.362321034s)
functional_test.go:444: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.61s)
=== RUN TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:66: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-225352 /tmp/TestFunctionalparallelMountCmdany-port180812264/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:100: wrote "test-1667343407270717670" to /tmp/TestFunctionalparallelMountCmdany-port180812264/001/created-by-test
functional_test_mount_test.go:100: wrote "test-1667343407270717670" to /tmp/TestFunctionalparallelMountCmdany-port180812264/001/created-by-test-removed-by-pod
functional_test_mount_test.go:100: wrote "test-1667343407270717670" to /tmp/TestFunctionalparallelMountCmdany-port180812264/001/test-1667343407270717670
functional_test_mount_test.go:108: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:108: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-225352 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (233.468263ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
=== CONT TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:108: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "findmnt -T /mount-9p | grep 9p"
=== CONT TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:122: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh -- ls -la /mount-9p
=== CONT TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:126: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Nov 1 22:56 created-by-test
-rw-r--r-- 1 docker docker 24 Nov 1 22:56 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Nov 1 22:56 test-1667343407270717670
functional_test_mount_test.go:130: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh cat /mount-9p/test-1667343407270717670
functional_test_mount_test.go:141: (dbg) Run: kubectl --context functional-225352 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:146: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:342: "busybox-mount" [991f4be5-6d1d-469c-a181-f49a5a4f27b8] Pending
=== CONT TestFunctional/parallel/MountCmd/any-port
helpers_test.go:342: "busybox-mount" [991f4be5-6d1d-469c-a181-f49a5a4f27b8] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
=== CONT TestFunctional/parallel/MountCmd/any-port
helpers_test.go:342: "busybox-mount" [991f4be5-6d1d-469c-a181-f49a5a4f27b8] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:342: "busybox-mount" [991f4be5-6d1d-469c-a181-f49a5a4f27b8] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:146: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 17.016845853s
functional_test_mount_test.go:162: (dbg) Run: kubectl --context functional-225352 logs busybox-mount
=== CONT TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:174: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh stat /mount-9p/created-by-test
=== CONT TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:174: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:83: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:87: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-225352 /tmp/TestFunctionalparallelMountCmdany-port180812264/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (19.75s)
=== RUN TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:415: (dbg) Run: docker rmi gcr.io/google-containers/addon-resizer:functional-225352
=== CONT TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:420: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 image save --daemon gcr.io/google-containers/addon-resizer:functional-225352
=== CONT TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:420: (dbg) Done: out/minikube-linux-amd64 -p functional-225352 image save --daemon gcr.io/google-containers/addon-resizer:functional-225352: (1.284098562s)
functional_test.go:425: (dbg) Run: docker image inspect gcr.io/google-containers/addon-resizer:functional-225352
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (1.33s)
=== RUN TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:206: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-225352 /tmp/TestFunctionalparallelMountCmdspecific-port3599273142/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:236: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "findmnt -T /mount-9p | grep 9p"
=== CONT TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:236: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-225352 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (263.832486ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
functional_test_mount_test.go:236: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:250: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh -- ls -la /mount-9p
functional_test_mount_test.go:254: guest mount directory contents
total 0
functional_test_mount_test.go:256: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-225352 /tmp/TestFunctionalparallelMountCmdspecific-port3599273142/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
=== CONT TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:257: reading mount text
functional_test_mount_test.go:271: done reading mount text
functional_test_mount_test.go:223: (dbg) Run: out/minikube-linux-amd64 -p functional-225352 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:227: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-225352 /tmp/TestFunctionalparallelMountCmdspecific-port3599273142/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.13s)
=== RUN TestFunctional/delete_addon-resizer_images
functional_test.go:186: (dbg) Run: docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:186: (dbg) Run: docker rmi -f gcr.io/google-containers/addon-resizer:functional-225352
--- PASS: TestFunctional/delete_addon-resizer_images (0.09s)
=== RUN TestFunctional/delete_my-image_image
functional_test.go:194: (dbg) Run: docker rmi -f localhost/my-image:functional-225352
--- PASS: TestFunctional/delete_my-image_image (0.02s)
=== RUN TestFunctional/delete_minikube_cached_images
functional_test.go:202: (dbg) Run: docker rmi -f minikube-local-cache-test:functional-225352
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)
=== RUN TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run: out/minikube-linux-amd64 start -p ingress-addon-legacy-225723 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=kvm2 --container-runtime=containerd
E1101 22:57:28.990461 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
ingress_addon_legacy_test.go:39: (dbg) Done: out/minikube-linux-amd64 start -p ingress-addon-legacy-225723 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=kvm2 --container-runtime=containerd: (1m26.180110817s)
--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (86.18s)
=== RUN TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run: out/minikube-linux-amd64 -p ingress-addon-legacy-225723 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-225723 addons enable ingress --alsologtostderr -v=5: (18.851823495s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (18.85s)
=== RUN TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run: out/minikube-linux-amd64 -p ingress-addon-legacy-225723 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.38s)
=== RUN TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:165: (dbg) Run: kubectl --context ingress-addon-legacy-225723 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:165: (dbg) Done: kubectl --context ingress-addon-legacy-225723 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (11.042101448s)
addons_test.go:185: (dbg) Run: kubectl --context ingress-addon-legacy-225723 replace --force -f testdata/nginx-ingress-v1beta1.yaml
addons_test.go:198: (dbg) Run: kubectl --context ingress-addon-legacy-225723 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:203: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:342: "nginx" [0a752432-f8b7-4e86-af30-ddf503f25586] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:342: "nginx" [0a752432-f8b7-4e86-af30-ddf503f25586] Running
addons_test.go:203: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 12.015575104s
addons_test.go:215: (dbg) Run: out/minikube-linux-amd64 -p ingress-addon-legacy-225723 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:239: (dbg) Run: kubectl --context ingress-addon-legacy-225723 replace --force -f testdata/ingress-dns-example-v1beta1.yaml
addons_test.go:244: (dbg) Run: out/minikube-linux-amd64 -p ingress-addon-legacy-225723 ip
addons_test.go:250: (dbg) Run: nslookup hello-john.test 192.168.39.18
addons_test.go:259: (dbg) Run: out/minikube-linux-amd64 -p ingress-addon-legacy-225723 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:259: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-225723 addons disable ingress-dns --alsologtostderr -v=1: (7.153303203s)
addons_test.go:264: (dbg) Run: out/minikube-linux-amd64 -p ingress-addon-legacy-225723 addons disable ingress --alsologtostderr -v=1
E1101 22:59:45.145816 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
addons_test.go:264: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-225723 addons disable ingress --alsologtostderr -v=1: (7.38368203s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddons (38.73s)
=== RUN TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 start -p json-output-225949 --output=json --user=testUser --memory=2200 --wait=true --driver=kvm2 --container-runtime=containerd
E1101 23:00:12.831120 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 start -p json-output-225949 --output=json --user=testUser --memory=2200 --wait=true --driver=kvm2 --container-runtime=containerd: (1m11.19212207s)
--- PASS: TestJSONOutput/start/Command (71.19s)
=== RUN TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)
=== RUN TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 pause -p json-output-225949 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.65s)
=== RUN TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)
=== RUN TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 unpause -p json-output-225949 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.62s)
=== RUN TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)
=== RUN TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 stop -p json-output-225949 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 stop -p json-output-225949 --output=json --user=testUser: (2.107681278s)
--- PASS: TestJSONOutput/stop/Command (2.11s)
=== RUN TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)
=== RUN TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestErrorJSONOutput
json_output_test.go:149: (dbg) Run: out/minikube-linux-amd64 start -p json-output-error-230104 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:149: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p json-output-error-230104 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (84.441759ms)
-- stdout --
{"specversion":"1.0","id":"a8bd89b1-8c06-4c2c-b3f3-b571e84ca4ee","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-230104] minikube v1.27.1 on Ubuntu 20.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
{"specversion":"1.0","id":"642e9469-aa4c-4c12-96d9-6c7db45e7ddb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=15232"}}
{"specversion":"1.0","id":"0129134f-87ad-4d7c-a3af-22e316166da1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
{"specversion":"1.0","id":"3b68a4c6-1d9e-4c10-88eb-29febef96c97","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/15232-3880/kubeconfig"}}
{"specversion":"1.0","id":"4bf8ef2d-115a-4ba0-859e-b28beffd7285","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube"}}
{"specversion":"1.0","id":"1b3cc560-5bcd-45bc-b305-5756b22f972f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
{"specversion":"1.0","id":"7fa8b65c-f849-4e1b-b200-600c5e631106","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-230104" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p json-output-error-230104
--- PASS: TestErrorJSONOutput (0.25s)
=== RUN TestMainNoArgs
main_test.go:68: (dbg) Run: out/minikube-linux-amd64
--- PASS: TestMainNoArgs (0.07s)
=== RUN TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run: out/minikube-linux-amd64 start -p first-230104 --driver=kvm2 --container-runtime=containerd
E1101 23:01:28.341012 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:01:28.346328 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:01:28.356626 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:01:28.376889 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:01:28.417202 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:01:28.497488 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:01:28.657888 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:01:28.978500 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:01:29.619501 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:01:30.900022 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:01:33.461107 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:01:38.581854 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:01:48.822010 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p first-230104 --driver=kvm2 --container-runtime=containerd: (55.12285957s)
minikube_profile_test.go:44: (dbg) Run: out/minikube-linux-amd64 start -p second-230104 --driver=kvm2 --container-runtime=containerd
E1101 23:02:09.302799 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:02:50.263775 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p second-230104 --driver=kvm2 --container-runtime=containerd: (55.517518601s)
minikube_profile_test.go:51: (dbg) Run: out/minikube-linux-amd64 profile first-230104
minikube_profile_test.go:55: (dbg) Run: out/minikube-linux-amd64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run: out/minikube-linux-amd64 profile second-230104
minikube_profile_test.go:55: (dbg) Run: out/minikube-linux-amd64 profile list -ojson
helpers_test.go:175: Cleaning up "second-230104" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p second-230104
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p second-230104: (1.050442957s)
helpers_test.go:175: Cleaning up "first-230104" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p first-230104
--- PASS: TestMinikubeProfile (113.61s)
=== RUN TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run: out/minikube-linux-amd64 start -p mount-start-1-230258 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=kvm2 --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-1-230258 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=kvm2 --container-runtime=containerd: (26.170247919s)
--- PASS: TestMountStart/serial/StartWithMountFirst (27.17s)
=== RUN TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run: out/minikube-linux-amd64 -p mount-start-1-230258 ssh -- ls /minikube-host
mount_start_test.go:127: (dbg) Run: out/minikube-linux-amd64 -p mount-start-1-230258 ssh -- mount | grep 9p
--- PASS: TestMountStart/serial/VerifyMountFirst (0.43s)
=== RUN TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run: out/minikube-linux-amd64 start -p mount-start-2-230258 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=kvm2 --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-230258 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=kvm2 --container-runtime=containerd: (26.042460299s)
--- PASS: TestMountStart/serial/StartWithMountSecond (27.04s)
=== RUN TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-230258 ssh -- ls /minikube-host
mount_start_test.go:127: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-230258 ssh -- mount | grep 9p
--- PASS: TestMountStart/serial/VerifyMountSecond (0.42s)
=== RUN TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run: out/minikube-linux-amd64 delete -p mount-start-1-230258 --alsologtostderr -v=5
--- PASS: TestMountStart/serial/DeleteFirst (0.90s)
=== RUN TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-230258 ssh -- ls /minikube-host
mount_start_test.go:127: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-230258 ssh -- mount | grep 9p
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.43s)
=== RUN TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run: out/minikube-linux-amd64 stop -p mount-start-2-230258
mount_start_test.go:155: (dbg) Done: out/minikube-linux-amd64 stop -p mount-start-2-230258: (1.189217168s)
--- PASS: TestMountStart/serial/Stop (1.19s)
=== RUN TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run: out/minikube-linux-amd64 start -p mount-start-2-230258
E1101 23:04:09.291477 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:04:09.296730 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:04:09.307001 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:04:09.327259 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:04:09.367515 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:04:09.447805 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:04:09.608179 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:04:09.928787 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:04:10.569735 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:04:11.850258 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:04:12.184829 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:04:14.411331 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
mount_start_test.go:166: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-230258: (21.037830741s)
--- PASS: TestMountStart/serial/RestartStopped (22.04s)
=== RUN TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-230258 ssh -- ls /minikube-host
mount_start_test.go:127: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-230258 ssh -- mount | grep 9p
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.43s)
=== RUN TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:83: (dbg) Run: out/minikube-linux-amd64 start -p multinode-230419 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=kvm2 --container-runtime=containerd
E1101 23:04:19.531509 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:04:29.772309 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:04:45.145934 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 23:04:50.253511 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:05:31.214576 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:06:28.341011 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
multinode_test.go:83: (dbg) Done: out/minikube-linux-amd64 start -p multinode-230419 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=kvm2 --container-runtime=containerd: (2m30.363193521s)
multinode_test.go:89: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (150.79s)
=== RUN TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:479: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:484: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- rollout status deployment/busybox
E1101 23:06:53.135658 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
multinode_test.go:484: (dbg) Done: out/minikube-linux-amd64 kubectl -p multinode-230419 -- rollout status deployment/busybox: (3.312043547s)
multinode_test.go:490: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:510: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- exec busybox-65db55d5d6-4vfdd -- nslookup kubernetes.io
multinode_test.go:510: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- exec busybox-65db55d5d6-8lsgg -- nslookup kubernetes.io
multinode_test.go:520: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- exec busybox-65db55d5d6-4vfdd -- nslookup kubernetes.default
multinode_test.go:520: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- exec busybox-65db55d5d6-8lsgg -- nslookup kubernetes.default
multinode_test.go:528: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- exec busybox-65db55d5d6-4vfdd -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:528: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- exec busybox-65db55d5d6-8lsgg -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (5.52s)
=== RUN TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:538: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:546: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- exec busybox-65db55d5d6-4vfdd -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:554: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- exec busybox-65db55d5d6-4vfdd -- sh -c "ping -c 1 192.168.39.1"
multinode_test.go:546: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- exec busybox-65db55d5d6-8lsgg -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
E1101 23:06:56.025022 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
multinode_test.go:554: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-230419 -- exec busybox-65db55d5d6-8lsgg -- sh -c "ping -c 1 192.168.39.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.94s)
=== RUN TestMultiNode/serial/AddNode
multinode_test.go:108: (dbg) Run: out/minikube-linux-amd64 node add -p multinode-230419 -v 3 --alsologtostderr
multinode_test.go:108: (dbg) Done: out/minikube-linux-amd64 node add -p multinode-230419 -v 3 --alsologtostderr: (1m3.12984094s)
multinode_test.go:114: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (63.73s)
=== RUN TestMultiNode/serial/ProfileList
multinode_test.go:130: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.24s)
=== RUN TestMultiNode/serial/CopyFile
multinode_test.go:171: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 status --output json --alsologtostderr
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 cp testdata/cp-test.txt multinode-230419:/home/docker/cp-test.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 cp multinode-230419:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2325284513/001/cp-test_multinode-230419.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 cp multinode-230419:/home/docker/cp-test.txt multinode-230419-m02:/home/docker/cp-test_multinode-230419_multinode-230419-m02.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419-m02 "sudo cat /home/docker/cp-test_multinode-230419_multinode-230419-m02.txt"
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 cp multinode-230419:/home/docker/cp-test.txt multinode-230419-m03:/home/docker/cp-test_multinode-230419_multinode-230419-m03.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419-m03 "sudo cat /home/docker/cp-test_multinode-230419_multinode-230419-m03.txt"
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 cp testdata/cp-test.txt multinode-230419-m02:/home/docker/cp-test.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 cp multinode-230419-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2325284513/001/cp-test_multinode-230419-m02.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 cp multinode-230419-m02:/home/docker/cp-test.txt multinode-230419:/home/docker/cp-test_multinode-230419-m02_multinode-230419.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419 "sudo cat /home/docker/cp-test_multinode-230419-m02_multinode-230419.txt"
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 cp multinode-230419-m02:/home/docker/cp-test.txt multinode-230419-m03:/home/docker/cp-test_multinode-230419-m02_multinode-230419-m03.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419-m03 "sudo cat /home/docker/cp-test_multinode-230419-m02_multinode-230419-m03.txt"
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 cp testdata/cp-test.txt multinode-230419-m03:/home/docker/cp-test.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 cp multinode-230419-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2325284513/001/cp-test_multinode-230419-m03.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 cp multinode-230419-m03:/home/docker/cp-test.txt multinode-230419:/home/docker/cp-test_multinode-230419-m03_multinode-230419.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419 "sudo cat /home/docker/cp-test_multinode-230419-m03_multinode-230419.txt"
helpers_test.go:554: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 cp multinode-230419-m03:/home/docker/cp-test.txt multinode-230419-m02:/home/docker/cp-test_multinode-230419-m03_multinode-230419-m02.txt
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:532: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 ssh -n multinode-230419-m02 "sudo cat /home/docker/cp-test_multinode-230419-m03_multinode-230419-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (8.09s)
=== RUN TestMultiNode/serial/StopNode
multinode_test.go:208: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 node stop m03
multinode_test.go:208: (dbg) Done: out/minikube-linux-amd64 -p multinode-230419 node stop m03: (1.310260024s)
multinode_test.go:214: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 status
multinode_test.go:214: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-230419 status: exit status 7 (450.726839ms)
-- stdout --
multinode-230419
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
multinode-230419-m02
type: Worker
host: Running
kubelet: Running
multinode-230419-m03
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
multinode_test.go:221: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 status --alsologtostderr
multinode_test.go:221: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-230419 status --alsologtostderr: exit status 7 (446.741155ms)
-- stdout --
multinode-230419
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
multinode-230419-m02
type: Worker
host: Running
kubelet: Running
multinode-230419-m03
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
** stderr **
I1101 23:08:10.287225 21382 out.go:296] Setting OutFile to fd 1 ...
I1101 23:08:10.287396 21382 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 23:08:10.287407 21382 out.go:309] Setting ErrFile to fd 2...
I1101 23:08:10.287412 21382 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 23:08:10.287519 21382 root.go:334] Updating PATH: /home/jenkins/minikube-integration/15232-3880/.minikube/bin
I1101 23:08:10.287669 21382 out.go:303] Setting JSON to false
I1101 23:08:10.287697 21382 mustload.go:65] Loading cluster: multinode-230419
I1101 23:08:10.287809 21382 notify.go:220] Checking for updates...
I1101 23:08:10.288141 21382 config.go:180] Loaded profile config "multinode-230419": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.25.3
I1101 23:08:10.288161 21382 status.go:255] checking status of multinode-230419 ...
I1101 23:08:10.288563 21382 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:08:10.288608 21382 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:08:10.304587 21382 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:33847
I1101 23:08:10.304980 21382 main.go:134] libmachine: () Calling .GetVersion
I1101 23:08:10.305470 21382 main.go:134] libmachine: Using API Version 1
I1101 23:08:10.305493 21382 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:08:10.305821 21382 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:08:10.305974 21382 main.go:134] libmachine: (multinode-230419) Calling .GetState
I1101 23:08:10.307652 21382 status.go:330] multinode-230419 host status = "Running" (err=<nil>)
I1101 23:08:10.307667 21382 host.go:66] Checking if "multinode-230419" exists ...
I1101 23:08:10.307913 21382 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:08:10.307950 21382 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:08:10.322572 21382 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:39719
I1101 23:08:10.322944 21382 main.go:134] libmachine: () Calling .GetVersion
I1101 23:08:10.323365 21382 main.go:134] libmachine: Using API Version 1
I1101 23:08:10.323388 21382 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:08:10.323664 21382 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:08:10.323838 21382 main.go:134] libmachine: (multinode-230419) Calling .GetIP
I1101 23:08:10.326559 21382 main.go:134] libmachine: (multinode-230419) DBG | domain multinode-230419 has defined MAC address 52:54:00:af:a2:58 in network mk-multinode-230419
I1101 23:08:10.326982 21382 main.go:134] libmachine: (multinode-230419) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:a2:58", ip: ""} in network mk-multinode-230419: {Iface:virbr1 ExpiryTime:2022-11-02 00:04:34 +0000 UTC Type:0 Mac:52:54:00:af:a2:58 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:multinode-230419 Clientid:01:52:54:00:af:a2:58}
I1101 23:08:10.327011 21382 main.go:134] libmachine: (multinode-230419) DBG | domain multinode-230419 has defined IP address 192.168.39.75 and MAC address 52:54:00:af:a2:58 in network mk-multinode-230419
I1101 23:08:10.327214 21382 host.go:66] Checking if "multinode-230419" exists ...
I1101 23:08:10.327529 21382 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:08:10.327598 21382 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:08:10.342289 21382 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:41391
I1101 23:08:10.342718 21382 main.go:134] libmachine: () Calling .GetVersion
I1101 23:08:10.343147 21382 main.go:134] libmachine: Using API Version 1
I1101 23:08:10.343172 21382 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:08:10.343466 21382 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:08:10.343632 21382 main.go:134] libmachine: (multinode-230419) Calling .DriverName
I1101 23:08:10.343844 21382 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1101 23:08:10.343875 21382 main.go:134] libmachine: (multinode-230419) Calling .GetSSHHostname
I1101 23:08:10.346270 21382 main.go:134] libmachine: (multinode-230419) DBG | domain multinode-230419 has defined MAC address 52:54:00:af:a2:58 in network mk-multinode-230419
I1101 23:08:10.346700 21382 main.go:134] libmachine: (multinode-230419) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:a2:58", ip: ""} in network mk-multinode-230419: {Iface:virbr1 ExpiryTime:2022-11-02 00:04:34 +0000 UTC Type:0 Mac:52:54:00:af:a2:58 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:multinode-230419 Clientid:01:52:54:00:af:a2:58}
I1101 23:08:10.346735 21382 main.go:134] libmachine: (multinode-230419) DBG | domain multinode-230419 has defined IP address 192.168.39.75 and MAC address 52:54:00:af:a2:58 in network mk-multinode-230419
I1101 23:08:10.346835 21382 main.go:134] libmachine: (multinode-230419) Calling .GetSSHPort
I1101 23:08:10.347015 21382 main.go:134] libmachine: (multinode-230419) Calling .GetSSHKeyPath
I1101 23:08:10.347167 21382 main.go:134] libmachine: (multinode-230419) Calling .GetSSHUsername
I1101 23:08:10.347322 21382 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/15232-3880/.minikube/machines/multinode-230419/id_rsa Username:docker}
I1101 23:08:10.434241 21382 ssh_runner.go:195] Run: systemctl --version
I1101 23:08:10.440627 21382 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1101 23:08:10.453467 21382 kubeconfig.go:92] found "multinode-230419" server: "https://192.168.39.75:8443"
I1101 23:08:10.453496 21382 api_server.go:165] Checking apiserver status ...
I1101 23:08:10.453521 21382 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1101 23:08:10.466118 21382 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1039/cgroup
I1101 23:08:10.474759 21382 api_server.go:181] apiserver freezer: "11:freezer:/kubepods/burstable/pod18b3215e24c9a73f11000109d1649e17/9213eee32f1ab4eedcbc71fee0523c71e20974da4d5a8e0c2d637dd147d2df54"
I1101 23:08:10.474839 21382 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/pod18b3215e24c9a73f11000109d1649e17/9213eee32f1ab4eedcbc71fee0523c71e20974da4d5a8e0c2d637dd147d2df54/freezer.state
I1101 23:08:10.483744 21382 api_server.go:203] freezer state: "THAWED"
I1101 23:08:10.483776 21382 api_server.go:252] Checking apiserver healthz at https://192.168.39.75:8443/healthz ...
I1101 23:08:10.489811 21382 api_server.go:278] https://192.168.39.75:8443/healthz returned 200:
ok
I1101 23:08:10.489839 21382 status.go:421] multinode-230419 apiserver status = Running (err=<nil>)
I1101 23:08:10.489850 21382 status.go:257] multinode-230419 status: &{Name:multinode-230419 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1101 23:08:10.489865 21382 status.go:255] checking status of multinode-230419-m02 ...
I1101 23:08:10.490259 21382 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:08:10.490307 21382 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:08:10.505499 21382 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:46693
I1101 23:08:10.505897 21382 main.go:134] libmachine: () Calling .GetVersion
I1101 23:08:10.506342 21382 main.go:134] libmachine: Using API Version 1
I1101 23:08:10.506372 21382 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:08:10.506738 21382 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:08:10.506910 21382 main.go:134] libmachine: (multinode-230419-m02) Calling .GetState
I1101 23:08:10.508498 21382 status.go:330] multinode-230419-m02 host status = "Running" (err=<nil>)
I1101 23:08:10.508513 21382 host.go:66] Checking if "multinode-230419-m02" exists ...
I1101 23:08:10.508847 21382 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:08:10.508886 21382 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:08:10.523693 21382 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:44187
I1101 23:08:10.524101 21382 main.go:134] libmachine: () Calling .GetVersion
I1101 23:08:10.524549 21382 main.go:134] libmachine: Using API Version 1
I1101 23:08:10.524571 21382 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:08:10.524912 21382 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:08:10.525075 21382 main.go:134] libmachine: (multinode-230419-m02) Calling .GetIP
I1101 23:08:10.527748 21382 main.go:134] libmachine: (multinode-230419-m02) DBG | domain multinode-230419-m02 has defined MAC address 52:54:00:b8:12:05 in network mk-multinode-230419
I1101 23:08:10.528118 21382 main.go:134] libmachine: (multinode-230419-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b8:12:05", ip: ""} in network mk-multinode-230419: {Iface:virbr1 ExpiryTime:2022-11-02 00:05:50 +0000 UTC Type:0 Mac:52:54:00:b8:12:05 Iaid: IPaddr:192.168.39.131 Prefix:24 Hostname:multinode-230419-m02 Clientid:01:52:54:00:b8:12:05}
I1101 23:08:10.528151 21382 main.go:134] libmachine: (multinode-230419-m02) DBG | domain multinode-230419-m02 has defined IP address 192.168.39.131 and MAC address 52:54:00:b8:12:05 in network mk-multinode-230419
I1101 23:08:10.528248 21382 host.go:66] Checking if "multinode-230419-m02" exists ...
I1101 23:08:10.528520 21382 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:08:10.528556 21382 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:08:10.543242 21382 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:42943
I1101 23:08:10.543611 21382 main.go:134] libmachine: () Calling .GetVersion
I1101 23:08:10.544055 21382 main.go:134] libmachine: Using API Version 1
I1101 23:08:10.544081 21382 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:08:10.544379 21382 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:08:10.544532 21382 main.go:134] libmachine: (multinode-230419-m02) Calling .DriverName
I1101 23:08:10.544700 21382 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1101 23:08:10.544724 21382 main.go:134] libmachine: (multinode-230419-m02) Calling .GetSSHHostname
I1101 23:08:10.547052 21382 main.go:134] libmachine: (multinode-230419-m02) DBG | domain multinode-230419-m02 has defined MAC address 52:54:00:b8:12:05 in network mk-multinode-230419
I1101 23:08:10.547437 21382 main.go:134] libmachine: (multinode-230419-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b8:12:05", ip: ""} in network mk-multinode-230419: {Iface:virbr1 ExpiryTime:2022-11-02 00:05:50 +0000 UTC Type:0 Mac:52:54:00:b8:12:05 Iaid: IPaddr:192.168.39.131 Prefix:24 Hostname:multinode-230419-m02 Clientid:01:52:54:00:b8:12:05}
I1101 23:08:10.547481 21382 main.go:134] libmachine: (multinode-230419-m02) DBG | domain multinode-230419-m02 has defined IP address 192.168.39.131 and MAC address 52:54:00:b8:12:05 in network mk-multinode-230419
I1101 23:08:10.547611 21382 main.go:134] libmachine: (multinode-230419-m02) Calling .GetSSHPort
I1101 23:08:10.547771 21382 main.go:134] libmachine: (multinode-230419-m02) Calling .GetSSHKeyPath
I1101 23:08:10.547921 21382 main.go:134] libmachine: (multinode-230419-m02) Calling .GetSSHUsername
I1101 23:08:10.548090 21382 sshutil.go:53] new ssh client: &{IP:192.168.39.131 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/15232-3880/.minikube/machines/multinode-230419-m02/id_rsa Username:docker}
I1101 23:08:10.637841 21382 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1101 23:08:10.650734 21382 status.go:257] multinode-230419-m02 status: &{Name:multinode-230419-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
I1101 23:08:10.650779 21382 status.go:255] checking status of multinode-230419-m03 ...
I1101 23:08:10.651176 21382 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:08:10.651226 21382 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:08:10.666385 21382 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:39173
I1101 23:08:10.666832 21382 main.go:134] libmachine: () Calling .GetVersion
I1101 23:08:10.667283 21382 main.go:134] libmachine: Using API Version 1
I1101 23:08:10.667308 21382 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:08:10.667643 21382 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:08:10.667815 21382 main.go:134] libmachine: (multinode-230419-m03) Calling .GetState
I1101 23:08:10.669388 21382 status.go:330] multinode-230419-m03 host status = "Stopped" (err=<nil>)
I1101 23:08:10.669407 21382 status.go:343] host is not running, skipping remaining checks
I1101 23:08:10.669413 21382 status.go:257] multinode-230419-m03 status: &{Name:multinode-230419-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.21s)
=== RUN TestMultiNode/serial/StartAfterStop
multinode_test.go:252: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 node start m03 --alsologtostderr
multinode_test.go:252: (dbg) Done: out/minikube-linux-amd64 -p multinode-230419 node start m03 --alsologtostderr: (43.946610735s)
multinode_test.go:259: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 status
multinode_test.go:273: (dbg) Run: kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (44.59s)
=== RUN TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:281: (dbg) Run: out/minikube-linux-amd64 node list -p multinode-230419
multinode_test.go:288: (dbg) Run: out/minikube-linux-amd64 stop -p multinode-230419
E1101 23:09:09.291215 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:09:36.975890 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:09:45.145515 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 23:11:08.193137 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 23:11:28.341646 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
multinode_test.go:288: (dbg) Done: out/minikube-linux-amd64 stop -p multinode-230419: (3m4.45933023s)
multinode_test.go:293: (dbg) Run: out/minikube-linux-amd64 start -p multinode-230419 --wait=true -v=8 --alsologtostderr
E1101 23:14:09.290871 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:14:45.146163 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 23:16:28.340733 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:17:51.385958 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
multinode_test.go:293: (dbg) Done: out/minikube-linux-amd64 start -p multinode-230419 --wait=true -v=8 --alsologtostderr: (6m31.938687076s)
multinode_test.go:298: (dbg) Run: out/minikube-linux-amd64 node list -p multinode-230419
--- PASS: TestMultiNode/serial/RestartKeepsNodes (576.53s)
=== RUN TestMultiNode/serial/DeleteNode
multinode_test.go:392: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 node delete m03
multinode_test.go:392: (dbg) Done: out/minikube-linux-amd64 -p multinode-230419 node delete m03: (1.546753503s)
multinode_test.go:398: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 status --alsologtostderr
multinode_test.go:422: (dbg) Run: kubectl get nodes
multinode_test.go:430: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (2.09s)
=== RUN TestMultiNode/serial/StopMultiNode
multinode_test.go:312: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 stop
E1101 23:19:09.290813 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:19:45.145540 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 23:20:32.337120 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:21:28.341924 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
multinode_test.go:312: (dbg) Done: out/minikube-linux-amd64 -p multinode-230419 stop: (3m3.315065875s)
multinode_test.go:318: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 status
multinode_test.go:318: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-230419 status: exit status 7 (104.552095ms)
-- stdout --
multinode-230419
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
multinode-230419-m02
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
multinode_test.go:325: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 status --alsologtostderr
multinode_test.go:325: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-230419 status --alsologtostderr: exit status 7 (101.050812ms)
-- stdout --
multinode-230419
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
multinode-230419-m02
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
** stderr **
I1101 23:21:37.368172 22997 out.go:296] Setting OutFile to fd 1 ...
I1101 23:21:37.368297 22997 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 23:21:37.368311 22997 out.go:309] Setting ErrFile to fd 2...
I1101 23:21:37.368318 22997 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 23:21:37.368432 22997 root.go:334] Updating PATH: /home/jenkins/minikube-integration/15232-3880/.minikube/bin
I1101 23:21:37.368586 22997 out.go:303] Setting JSON to false
I1101 23:21:37.368613 22997 mustload.go:65] Loading cluster: multinode-230419
I1101 23:21:37.368732 22997 notify.go:220] Checking for updates...
I1101 23:21:37.369060 22997 config.go:180] Loaded profile config "multinode-230419": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.25.3
I1101 23:21:37.369080 22997 status.go:255] checking status of multinode-230419 ...
I1101 23:21:37.369560 22997 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:21:37.369625 22997 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:21:37.384891 22997 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:35079
I1101 23:21:37.385242 22997 main.go:134] libmachine: () Calling .GetVersion
I1101 23:21:37.385723 22997 main.go:134] libmachine: Using API Version 1
I1101 23:21:37.385749 22997 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:21:37.386110 22997 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:21:37.386293 22997 main.go:134] libmachine: (multinode-230419) Calling .GetState
I1101 23:21:37.387710 22997 status.go:330] multinode-230419 host status = "Stopped" (err=<nil>)
I1101 23:21:37.387727 22997 status.go:343] host is not running, skipping remaining checks
I1101 23:21:37.387734 22997 status.go:257] multinode-230419 status: &{Name:multinode-230419 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1101 23:21:37.387754 22997 status.go:255] checking status of multinode-230419-m02 ...
I1101 23:21:37.388004 22997 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I1101 23:21:37.388035 22997 main.go:134] libmachine: Launching plugin server for driver kvm2
I1101 23:21:37.402798 22997 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:41709
I1101 23:21:37.403200 22997 main.go:134] libmachine: () Calling .GetVersion
I1101 23:21:37.403631 22997 main.go:134] libmachine: Using API Version 1
I1101 23:21:37.403654 22997 main.go:134] libmachine: () Calling .SetConfigRaw
I1101 23:21:37.403976 22997 main.go:134] libmachine: () Calling .GetMachineName
I1101 23:21:37.404136 22997 main.go:134] libmachine: (multinode-230419-m02) Calling .GetState
I1101 23:21:37.405552 22997 status.go:330] multinode-230419-m02 host status = "Stopped" (err=<nil>)
I1101 23:21:37.405568 22997 status.go:343] host is not running, skipping remaining checks
I1101 23:21:37.405573 22997 status.go:257] multinode-230419-m02 status: &{Name:multinode-230419-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (183.52s)
=== RUN TestMultiNode/serial/RestartMultiNode
multinode_test.go:352: (dbg) Run: out/minikube-linux-amd64 start -p multinode-230419 --wait=true -v=8 --alsologtostderr --driver=kvm2 --container-runtime=containerd
E1101 23:24:09.290740 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:24:45.145916 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
multinode_test.go:352: (dbg) Done: out/minikube-linux-amd64 start -p multinode-230419 --wait=true -v=8 --alsologtostderr --driver=kvm2 --container-runtime=containerd: (3m31.077954644s)
multinode_test.go:358: (dbg) Run: out/minikube-linux-amd64 -p multinode-230419 status --alsologtostderr
multinode_test.go:372: (dbg) Run: kubectl get nodes
multinode_test.go:380: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (211.63s)
=== RUN TestMultiNode/serial/ValidateNameConflict
multinode_test.go:441: (dbg) Run: out/minikube-linux-amd64 node list -p multinode-230419
multinode_test.go:450: (dbg) Run: out/minikube-linux-amd64 start -p multinode-230419-m02 --driver=kvm2 --container-runtime=containerd
multinode_test.go:450: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p multinode-230419-m02 --driver=kvm2 --container-runtime=containerd: exit status 14 (84.7369ms)
-- stdout --
* [multinode-230419-m02] minikube v1.27.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=15232
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/15232-3880/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
-- /stdout --
** stderr **
! Profile name 'multinode-230419-m02' is duplicated with machine name 'multinode-230419-m02' in profile 'multinode-230419'
X Exiting due to MK_USAGE: Profile name should be unique
** /stderr **
multinode_test.go:458: (dbg) Run: out/minikube-linux-amd64 start -p multinode-230419-m03 --driver=kvm2 --container-runtime=containerd
multinode_test.go:458: (dbg) Done: out/minikube-linux-amd64 start -p multinode-230419-m03 --driver=kvm2 --container-runtime=containerd: (54.500068004s)
multinode_test.go:465: (dbg) Run: out/minikube-linux-amd64 node add -p multinode-230419
multinode_test.go:465: (dbg) Non-zero exit: out/minikube-linux-amd64 node add -p multinode-230419: exit status 80 (245.58595ms)
-- stdout --
* Adding node m03 to cluster multinode-230419
-- /stdout --
** stderr **
X Exiting due to GUEST_NODE_ADD: Node multinode-230419-m03 already exists in multinode-230419-m03 profile
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
multinode_test.go:470: (dbg) Run: out/minikube-linux-amd64 delete -p multinode-230419-m03
multinode_test.go:470: (dbg) Done: out/minikube-linux-amd64 delete -p multinode-230419-m03: (1.034392602s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (55.93s)
=== RUN TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run: out/minikube-linux-amd64 start -p scheduled-stop-232900 --memory=2048 --driver=kvm2 --container-runtime=containerd
E1101 23:29:09.291652 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:29:45.145723 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-amd64 start -p scheduled-stop-232900 --memory=2048 --driver=kvm2 --container-runtime=containerd: (54.79459868s)
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-232900 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run: out/minikube-linux-amd64 status --format={{.TimeToStop}} -p scheduled-stop-232900 -n scheduled-stop-232900
scheduled_stop_test.go:169: signal error was: <nil>
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-232900 --schedule 15s
scheduled_stop_test.go:169: signal error was: os: process already finished
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-232900 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-232900 -n scheduled-stop-232900
scheduled_stop_test.go:205: (dbg) Run: out/minikube-linux-amd64 status -p scheduled-stop-232900
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-232900 --schedule 15s
scheduled_stop_test.go:169: signal error was: os: process already finished
scheduled_stop_test.go:205: (dbg) Run: out/minikube-linux-amd64 status -p scheduled-stop-232900
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p scheduled-stop-232900: exit status 7 (86.233158ms)
-- stdout --
scheduled-stop-232900
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-232900 -n scheduled-stop-232900
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-232900 -n scheduled-stop-232900: exit status 7 (86.840214ms)
-- stdout --
Stopped
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-232900" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p scheduled-stop-232900
--- PASS: TestScheduledStopUnix (126.71s)
=== RUN TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade
=== CONT TestRunningBinaryUpgrade
=== CONT TestRunningBinaryUpgrade
version_upgrade_test.go:127: (dbg) Run: /tmp/minikube-v1.16.0.2620723166.exe start -p running-upgrade-233255 --memory=2200 --vm-driver=kvm2 --container-runtime=containerd
=== CONT TestRunningBinaryUpgrade
version_upgrade_test.go:127: (dbg) Done: /tmp/minikube-v1.16.0.2620723166.exe start -p running-upgrade-233255 --memory=2200 --vm-driver=kvm2 --container-runtime=containerd: (1m45.316248581s)
version_upgrade_test.go:137: (dbg) Run: out/minikube-linux-amd64 start -p running-upgrade-233255 --memory=2200 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=containerd
=== CONT TestRunningBinaryUpgrade
version_upgrade_test.go:137: (dbg) Done: out/minikube-linux-amd64 start -p running-upgrade-233255 --memory=2200 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=containerd: (50.250784514s)
helpers_test.go:175: Cleaning up "running-upgrade-233255" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p running-upgrade-233255
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p running-upgrade-233255: (1.774838122s)
--- PASS: TestRunningBinaryUpgrade (158.66s)
=== RUN TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade
=== CONT TestKubernetesUpgrade
version_upgrade_test.go:229: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-233108 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=containerd
E1101 23:31:28.342202 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
=== CONT TestKubernetesUpgrade
version_upgrade_test.go:229: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-233108 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=containerd: (2m19.597375088s)
version_upgrade_test.go:234: (dbg) Run: out/minikube-linux-amd64 stop -p kubernetes-upgrade-233108
version_upgrade_test.go:234: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-233108: (2.483935094s)
version_upgrade_test.go:239: (dbg) Run: out/minikube-linux-amd64 -p kubernetes-upgrade-233108 status --format={{.Host}}
version_upgrade_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-233108 status --format={{.Host}}: exit status 7 (86.632637ms)
-- stdout --
Stopped
-- /stdout --
version_upgrade_test.go:241: status error: exit status 7 (may be ok)
version_upgrade_test.go:250: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-233108 --memory=2200 --kubernetes-version=v1.25.3 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=containerd
=== CONT TestKubernetesUpgrade
version_upgrade_test.go:250: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-233108 --memory=2200 --kubernetes-version=v1.25.3 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=containerd: (1m46.256353134s)
version_upgrade_test.go:255: (dbg) Run: kubectl --context kubernetes-upgrade-233108 version --output=json
version_upgrade_test.go:274: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:276: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-233108 --memory=2200 --kubernetes-version=v1.16.0 --driver=kvm2 --container-runtime=containerd
version_upgrade_test.go:276: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-233108 --memory=2200 --kubernetes-version=v1.16.0 --driver=kvm2 --container-runtime=containerd: exit status 106 (177.744492ms)
-- stdout --
* [kubernetes-upgrade-233108] minikube v1.27.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=15232
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/15232-3880/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
-- /stdout --
** stderr **
X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.25.3 cluster to v1.16.0
* Suggestion:
1) Recreate the cluster with Kubernetes 1.16.0, by running:
minikube delete -p kubernetes-upgrade-233108
minikube start -p kubernetes-upgrade-233108 --kubernetes-version=v1.16.0
2) Create a second cluster with Kubernetes 1.16.0, by running:
minikube start -p kubernetes-upgrade-2331082 --kubernetes-version=v1.16.0
3) Use the existing cluster at version Kubernetes 1.25.3, by running:
minikube start -p kubernetes-upgrade-233108 --kubernetes-version=v1.25.3
** /stderr **
version_upgrade_test.go:280: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:282: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-233108 --memory=2200 --kubernetes-version=v1.25.3 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=containerd
=== CONT TestKubernetesUpgrade
version_upgrade_test.go:282: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-233108 --memory=2200 --kubernetes-version=v1.25.3 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=containerd: (31.585423847s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-233108" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p kubernetes-upgrade-233108
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p kubernetes-upgrade-233108: (1.423867852s)
--- PASS: TestKubernetesUpgrade (281.72s)
=== RUN TestNoKubernetes/serial/StartNoK8sWithVersion
=== CONT TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-233107 --no-kubernetes --kubernetes-version=1.20 --driver=kvm2 --container-runtime=containerd
=== CONT TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p NoKubernetes-233107 --no-kubernetes --kubernetes-version=1.20 --driver=kvm2 --container-runtime=containerd: exit status 14 (119.640006ms)
-- stdout --
* [NoKubernetes-233107] minikube v1.27.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=15232
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/15232-3880/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
-- /stdout --
** stderr **
X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
to unset a global config run:
$ minikube config unset kubernetes-version
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.12s)
=== RUN TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-233107 --driver=kvm2 --container-runtime=containerd
=== CONT TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-233107 --driver=kvm2 --container-runtime=containerd: (1m47.338840261s)
no_kubernetes_test.go:200: (dbg) Run: out/minikube-linux-amd64 -p NoKubernetes-233107 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (107.65s)
=== RUN TestNetworkPlugins/group/false
net_test.go:220: (dbg) Run: out/minikube-linux-amd64 start -p false-233107 --memory=2048 --alsologtostderr --cni=false --driver=kvm2 --container-runtime=containerd
net_test.go:220: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p false-233107 --memory=2048 --alsologtostderr --cni=false --driver=kvm2 --container-runtime=containerd: exit status 14 (133.045256ms)
-- stdout --
* [false-233107] minikube v1.27.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=15232
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/15232-3880/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
* Using the kvm2 driver based on user configuration
-- /stdout --
** stderr **
I1101 23:31:08.026249 25230 out.go:296] Setting OutFile to fd 1 ...
I1101 23:31:08.026647 25230 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 23:31:08.026692 25230 out.go:309] Setting ErrFile to fd 2...
I1101 23:31:08.026710 25230 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1101 23:31:08.026987 25230 root.go:334] Updating PATH: /home/jenkins/minikube-integration/15232-3880/.minikube/bin
I1101 23:31:08.028108 25230 out.go:303] Setting JSON to false
I1101 23:31:08.028964 25230 start.go:116] hostinfo: {"hostname":"ubuntu-20-agent-5","uptime":4422,"bootTime":1667341046,"procs":207,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1021-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1101 23:31:08.029096 25230 start.go:126] virtualization: kvm guest
I1101 23:31:08.031791 25230 out.go:177] * [false-233107] minikube v1.27.1 on Ubuntu 20.04 (kvm/amd64)
I1101 23:31:08.034042 25230 notify.go:220] Checking for updates...
I1101 23:31:08.035525 25230 out.go:177] - MINIKUBE_LOCATION=15232
I1101 23:31:08.037084 25230 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1101 23:31:08.038622 25230 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/15232-3880/kubeconfig
I1101 23:31:08.040211 25230 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/15232-3880/.minikube
I1101 23:31:08.041716 25230 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I1101 23:31:08.043786 25230 config.go:180] Loaded profile config "NoKubernetes-233107": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.25.3
I1101 23:31:08.043900 25230 config.go:180] Loaded profile config "force-systemd-env-233107": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.25.3
I1101 23:31:08.043980 25230 config.go:180] Loaded profile config "offline-containerd-233107": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.25.3
I1101 23:31:08.044015 25230 driver.go:365] Setting default libvirt URI to qemu:///system
I1101 23:31:08.077479 25230 out.go:177] * Using the kvm2 driver based on user configuration
I1101 23:31:08.078866 25230 start.go:282] selected driver: kvm2
I1101 23:31:08.078906 25230 start.go:808] validating driver "kvm2" against <nil>
I1101 23:31:08.078923 25230 start.go:819] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1101 23:31:08.081252 25230 out.go:177]
W1101 23:31:08.082769 25230 out.go:239] X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
I1101 23:31:08.084334 25230 out.go:177]
** /stderr **
helpers_test.go:175: Cleaning up "false-233107" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p false-233107
--- PASS: TestNetworkPlugins/group/false (0.33s)
=== RUN TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (3.91s)
=== RUN TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-233107 --no-kubernetes --driver=kvm2 --container-runtime=containerd
=== CONT TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-233107 --no-kubernetes --driver=kvm2 --container-runtime=containerd: (16.19037823s)
no_kubernetes_test.go:200: (dbg) Run: out/minikube-linux-amd64 -p NoKubernetes-233107 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-amd64 -p NoKubernetes-233107 status -o json: exit status 2 (325.055088ms)
-- stdout --
{"Name":"NoKubernetes-233107","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run: out/minikube-linux-amd64 delete -p NoKubernetes-233107
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-amd64 delete -p NoKubernetes-233107: (1.360041334s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (17.88s)
=== RUN TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-233107 --no-kubernetes --driver=kvm2 --container-runtime=containerd
=== CONT TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-233107 --no-kubernetes --driver=kvm2 --container-runtime=containerd: (46.963576625s)
--- PASS: TestNoKubernetes/serial/Start (46.96s)
=== RUN TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run: out/minikube-linux-amd64 ssh -p NoKubernetes-233107 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-233107 "sudo systemctl is-active --quiet service kubelet": exit status 1 (236.712489ms)
** stderr **
ssh: Process exited with status 3
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.24s)
=== RUN TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run: out/minikube-linux-amd64 profile list
no_kubernetes_test.go:169: (dbg) Done: out/minikube-linux-amd64 profile list: (3.799826662s)
no_kubernetes_test.go:179: (dbg) Run: out/minikube-linux-amd64 profile list --output=json
no_kubernetes_test.go:179: (dbg) Done: out/minikube-linux-amd64 profile list --output=json: (2.819203915s)
--- PASS: TestNoKubernetes/serial/ProfileList (6.62s)
=== RUN TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run: out/minikube-linux-amd64 stop -p NoKubernetes-233107
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-amd64 stop -p NoKubernetes-233107: (1.302716672s)
--- PASS: TestNoKubernetes/serial/Stop (1.30s)
=== RUN TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-233107 --driver=kvm2 --container-runtime=containerd
E1101 23:34:09.291066 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:34:31.387024 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
=== CONT TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-233107 --driver=kvm2 --container-runtime=containerd: (33.975570906s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (33.98s)
=== RUN TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run: out/minikube-linux-amd64 ssh -p NoKubernetes-233107 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-233107 "sudo systemctl is-active --quiet service kubelet": exit status 1 (248.00835ms)
** stderr **
ssh: Process exited with status 3
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.25s)
=== RUN TestPause/serial/Start
pause_test.go:80: (dbg) Run: out/minikube-linux-amd64 start -p pause-233443 --memory=2048 --install-addons=false --wait=all --driver=kvm2 --container-runtime=containerd
E1101 23:34:45.145445 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
=== CONT TestPause/serial/Start
pause_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -p pause-233443 --memory=2048 --install-addons=false --wait=all --driver=kvm2 --container-runtime=containerd: (1m20.580051598s)
--- PASS: TestPause/serial/Start (80.58s)
=== RUN TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run: out/minikube-linux-amd64 start -p pause-233443 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=containerd
E1101 23:36:28.340714 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
=== CONT TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Done: out/minikube-linux-amd64 start -p pause-233443 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=containerd: (58.484969901s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (58.51s)
=== RUN TestPause/serial/Pause
pause_test.go:110: (dbg) Run: out/minikube-linux-amd64 pause -p pause-233443 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.83s)
=== RUN TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run: out/minikube-linux-amd64 status -p pause-233443 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p pause-233443 --output=json --layout=cluster: exit status 2 (338.124398ms)
-- stdout --
{"Name":"pause-233443","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 7 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.27.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-233443","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.34s)
=== RUN TestPause/serial/Unpause
pause_test.go:121: (dbg) Run: out/minikube-linux-amd64 unpause -p pause-233443 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.83s)
=== RUN TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run: out/minikube-linux-amd64 pause -p pause-233443 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-amd64 pause -p pause-233443 --alsologtostderr -v=5: (1.043600213s)
--- PASS: TestPause/serial/PauseAgain (1.04s)
=== RUN TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run: out/minikube-linux-amd64 delete -p pause-233443 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-amd64 delete -p pause-233443 --alsologtostderr -v=5: (1.198295832s)
--- PASS: TestPause/serial/DeletePaused (1.20s)
=== RUN TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run: out/minikube-linux-amd64 profile list --output json
=== CONT TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Done: out/minikube-linux-amd64 profile list --output json: (16.795700824s)
--- PASS: TestPause/serial/VerifyDeletedResources (16.80s)
=== RUN TestNetworkPlugins/group/auto/Start
net_test.go:101: (dbg) Run: out/minikube-linux-amd64 start -p auto-233107 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --driver=kvm2 --container-runtime=containerd
=== CONT TestNetworkPlugins/group/auto/Start
net_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p auto-233107 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --driver=kvm2 --container-runtime=containerd: (1m42.990714035s)
--- PASS: TestNetworkPlugins/group/auto/Start (102.99s)
=== RUN TestNetworkPlugins/group/kindnet/Start
net_test.go:101: (dbg) Run: out/minikube-linux-amd64 start -p kindnet-233107 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=kindnet --driver=kvm2 --container-runtime=containerd
=== CONT TestNetworkPlugins/group/kindnet/Start
net_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p kindnet-233107 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=kindnet --driver=kvm2 --container-runtime=containerd: (1m25.55656488s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (85.56s)
=== RUN TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:122: (dbg) Run: out/minikube-linux-amd64 ssh -p auto-233107 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.31s)
=== RUN TestNetworkPlugins/group/auto/NetCatPod
net_test.go:138: (dbg) Run: kubectl --context auto-233107 replace --force -f testdata/netcat-deployment.yaml
net_test.go:152: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:342: "netcat-5788d667bd-ncq6w" [49091066-5799-4e76-8cb5-ab98797e4e10] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E1101 23:39:09.290804 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
helpers_test.go:342: "netcat-5788d667bd-ncq6w" [49091066-5799-4e76-8cb5-ab98797e4e10] Running
net_test.go:152: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 17.016614251s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (17.55s)
=== RUN TestNetworkPlugins/group/auto/DNS
net_test.go:169: (dbg) Run: kubectl --context auto-233107 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.22s)
=== RUN TestNetworkPlugins/group/auto/Localhost
net_test.go:188: (dbg) Run: kubectl --context auto-233107 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.17s)
=== RUN TestNetworkPlugins/group/auto/HairPin
net_test.go:238: (dbg) Run: kubectl --context auto-233107 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.17s)
=== RUN TestNetworkPlugins/group/cilium/Start
net_test.go:101: (dbg) Run: out/minikube-linux-amd64 start -p cilium-233108 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=kvm2 --container-runtime=containerd
=== CONT TestNetworkPlugins/group/cilium/Start
net_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p cilium-233108 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=kvm2 --container-runtime=containerd: (1m52.437100543s)
--- PASS: TestNetworkPlugins/group/cilium/Start (112.44s)
=== RUN TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:109: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:342: "kindnet-gcl2p" [83bdd243-8d96-42fa-ab16-d3f679a54379] Running
net_test.go:109: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 5.01976815s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (5.02s)
=== RUN TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:122: (dbg) Run: out/minikube-linux-amd64 ssh -p kindnet-233107 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.36s)
=== RUN TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:138: (dbg) Run: kubectl --context kindnet-233107 replace --force -f testdata/netcat-deployment.yaml
net_test.go:138: (dbg) Done: kubectl --context kindnet-233107 replace --force -f testdata/netcat-deployment.yaml: (1.46639703s)
net_test.go:152: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:342: "netcat-5788d667bd-gz8ds" [a30b7247-5497-41ef-b0e9-835f844f84cc] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:342: "netcat-5788d667bd-gz8ds" [a30b7247-5497-41ef-b0e9-835f844f84cc] Running
net_test.go:152: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 11.027945171s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (13.93s)
=== RUN TestNetworkPlugins/group/kindnet/DNS
net_test.go:169: (dbg) Run: kubectl --context kindnet-233107 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.23s)
=== RUN TestNetworkPlugins/group/kindnet/Localhost
net_test.go:188: (dbg) Run: kubectl --context kindnet-233107 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.18s)
=== RUN TestNetworkPlugins/group/kindnet/HairPin
net_test.go:238: (dbg) Run: kubectl --context kindnet-233107 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.17s)
=== RUN TestNetworkPlugins/group/calico/Start
net_test.go:101: (dbg) Run: out/minikube-linux-amd64 start -p calico-233108 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=kvm2 --container-runtime=containerd
=== CONT TestNetworkPlugins/group/calico/Start
net_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p calico-233108 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=kvm2 --container-runtime=containerd: (5m51.699669725s)
--- PASS: TestNetworkPlugins/group/calico/Start (351.70s)
=== RUN TestNetworkPlugins/group/custom-flannel/Start
net_test.go:101: (dbg) Run: out/minikube-linux-amd64 start -p custom-flannel-233108 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=testdata/kube-flannel.yaml --driver=kvm2 --container-runtime=containerd
=== CONT TestNetworkPlugins/group/custom-flannel/Start
net_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p custom-flannel-233108 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=testdata/kube-flannel.yaml --driver=kvm2 --container-runtime=containerd: (1m50.520458871s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (110.52s)
=== RUN TestNetworkPlugins/group/cilium/ControllerPod
net_test.go:109: (dbg) TestNetworkPlugins/group/cilium/ControllerPod: waiting 10m0s for pods matching "k8s-app=cilium" in namespace "kube-system" ...
helpers_test.go:342: "cilium-khwhp" [6c6804ae-7d20-4dbb-a1ea-8c99075da892] Running
net_test.go:109: (dbg) TestNetworkPlugins/group/cilium/ControllerPod: k8s-app=cilium healthy within 5.043573003s
--- PASS: TestNetworkPlugins/group/cilium/ControllerPod (5.04s)
=== RUN TestNetworkPlugins/group/cilium/KubeletFlags
net_test.go:122: (dbg) Run: out/minikube-linux-amd64 ssh -p cilium-233108 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/cilium/KubeletFlags (0.41s)
=== RUN TestNetworkPlugins/group/cilium/NetCatPod
net_test.go:138: (dbg) Run: kubectl --context cilium-233108 replace --force -f testdata/netcat-deployment.yaml
net_test.go:138: (dbg) Done: kubectl --context cilium-233108 replace --force -f testdata/netcat-deployment.yaml: (2.21360033s)
net_test.go:152: (dbg) TestNetworkPlugins/group/cilium/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:342: "netcat-5788d667bd-z28zp" [2cabf854-239c-41f4-8202-bf49205e1538] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E1101 23:41:28.340878 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
helpers_test.go:342: "netcat-5788d667bd-z28zp" [2cabf854-239c-41f4-8202-bf49205e1538] Running
net_test.go:152: (dbg) TestNetworkPlugins/group/cilium/NetCatPod: app=netcat healthy within 14.016825541s
--- PASS: TestNetworkPlugins/group/cilium/NetCatPod (16.33s)
=== RUN TestNetworkPlugins/group/cilium/DNS
net_test.go:169: (dbg) Run: kubectl --context cilium-233108 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/cilium/DNS (0.40s)
=== RUN TestNetworkPlugins/group/cilium/Localhost
net_test.go:188: (dbg) Run: kubectl --context cilium-233108 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/cilium/Localhost (0.24s)
=== RUN TestNetworkPlugins/group/cilium/HairPin
net_test.go:238: (dbg) Run: kubectl --context cilium-233108 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/cilium/HairPin (0.29s)
=== RUN TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:101: (dbg) Run: out/minikube-linux-amd64 start -p enable-default-cni-233107 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --enable-default-cni=true --driver=kvm2 --container-runtime=containerd
=== CONT TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p enable-default-cni-233107 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --enable-default-cni=true --driver=kvm2 --container-runtime=containerd: (2m12.860543071s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (132.86s)
=== RUN TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:122: (dbg) Run: out/minikube-linux-amd64 ssh -p custom-flannel-233108 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.28s)
=== RUN TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:138: (dbg) Run: kubectl --context custom-flannel-233108 replace --force -f testdata/netcat-deployment.yaml
net_test.go:152: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:342: "netcat-5788d667bd-8f96m" [15ab993b-c158-43d7-87e0-cd1f50b8cf68] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:342: "netcat-5788d667bd-8f96m" [15ab993b-c158-43d7-87e0-cd1f50b8cf68] Running
net_test.go:152: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 13.009371619s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (13.38s)
=== RUN TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:169: (dbg) Run: kubectl --context custom-flannel-233108 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.22s)
=== RUN TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:188: (dbg) Run: kubectl --context custom-flannel-233108 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.25s)
=== RUN TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:238: (dbg) Run: kubectl --context custom-flannel-233108 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.17s)
=== RUN TestNetworkPlugins/group/bridge/Start
net_test.go:101: (dbg) Run: out/minikube-linux-amd64 start -p bridge-233107 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=bridge --driver=kvm2 --container-runtime=containerd
=== CONT TestNetworkPlugins/group/bridge/Start
net_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p bridge-233107 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=bridge --driver=kvm2 --container-runtime=containerd: (1m58.668935577s)
--- PASS: TestNetworkPlugins/group/bridge/Start (118.67s)
=== RUN TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:122: (dbg) Run: out/minikube-linux-amd64 ssh -p enable-default-cni-233107 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.28s)
=== RUN TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:138: (dbg) Run: kubectl --context enable-default-cni-233107 replace --force -f testdata/netcat-deployment.yaml
net_test.go:152: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:342: "netcat-5788d667bd-cvpjw" [8c3c869e-658c-4836-800f-b80adfd4b4bb] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:342: "netcat-5788d667bd-cvpjw" [8c3c869e-658c-4836-800f-b80adfd4b4bb] Running
E1101 23:44:07.855360 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:44:07.860652 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:44:07.870950 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:44:07.891258 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:44:07.931543 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:44:08.011806 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
net_test.go:152: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 11.010769788s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (11.46s)
=== RUN TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:169: (dbg) Run: kubectl --context enable-default-cni-233107 exec deployment/netcat -- nslookup kubernetes.default
E1101 23:44:08.172560 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.22s)
=== RUN TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:188: (dbg) Run: kubectl --context enable-default-cni-233107 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.18s)
=== RUN TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:238: (dbg) Run: kubectl --context enable-default-cni-233107 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
E1101 23:44:08.493032 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.17s)
=== RUN TestNetworkPlugins/group/flannel/Start
net_test.go:101: (dbg) Run: out/minikube-linux-amd64 start -p flannel-233107 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=flannel --driver=kvm2 --container-runtime=containerd
E1101 23:44:10.414654 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:44:12.975107 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:44:18.096019 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:44:28.193937 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 23:44:28.336172 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
=== CONT TestNetworkPlugins/group/flannel/Start
net_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p flannel-233107 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=flannel --driver=kvm2 --container-runtime=containerd: (1m24.637301629s)
--- PASS: TestNetworkPlugins/group/flannel/Start (84.64s)
=== RUN TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:122: (dbg) Run: out/minikube-linux-amd64 ssh -p bridge-233107 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.27s)
=== RUN TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:138: (dbg) Run: kubectl --context bridge-233107 replace --force -f testdata/netcat-deployment.yaml
net_test.go:152: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:342: "netcat-5788d667bd-56t7n" [23187592-98cc-441b-bb45-7ed925a29a4c] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:342: "netcat-5788d667bd-56t7n" [23187592-98cc-441b-bb45-7ed925a29a4c] Running
E1101 23:44:45.145768 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
net_test.go:152: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 11.021303965s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (11.46s)
=== RUN TestNetworkPlugins/group/bridge/DNS
net_test.go:169: (dbg) Run: kubectl --context bridge-233107 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.25s)
=== RUN TestNetworkPlugins/group/bridge/Localhost
net_test.go:188: (dbg) Run: kubectl --context bridge-233107 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.19s)
=== RUN TestNetworkPlugins/group/bridge/HairPin
net_test.go:238: (dbg) Run: kubectl --context bridge-233107 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.19s)
=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-234448 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.16.0
E1101 23:44:48.816576 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:44:54.739529 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:44:54.744830 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:44:54.755122 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:44:54.775411 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:44:54.815694 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:44:54.896466 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:44:55.056747 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:44:55.377092 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:44:56.018034 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:44:57.298567 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:44:59.859451 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:45:04.979702 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:45:15.220925 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:45:29.777581 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
=== CONT TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-234448 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.16.0: (2m34.833657936s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (154.83s)
=== RUN TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:109: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-system" ...
helpers_test.go:342: "kube-flannel-ds-amd64-th2x5" [d93dc805-a021-4655-ab38-6a8a5ec5cf1e] Pending: Initialized:ContainersNotInitialized (containers with incomplete status: [install-cni]) / Ready:ContainersNotReady (containers with unready status: [kube-flannel]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-flannel])
helpers_test.go:342: "kube-flannel-ds-amd64-th2x5" [d93dc805-a021-4655-ab38-6a8a5ec5cf1e] Pending / Ready:ContainersNotReady (containers with unready status: [kube-flannel]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-flannel])
E1101 23:45:35.701720 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
helpers_test.go:342: "kube-flannel-ds-amd64-th2x5" [d93dc805-a021-4655-ab38-6a8a5ec5cf1e] Running
net_test.go:109: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 7.03017142s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (7.03s)
=== RUN TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:122: (dbg) Run: out/minikube-linux-amd64 ssh -p flannel-233107 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.29s)
=== RUN TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:138: (dbg) Run: kubectl --context flannel-233107 replace --force -f testdata/netcat-deployment.yaml
net_test.go:152: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:342: "netcat-5788d667bd-s9kkd" [205c0009-1e3f-4f16-8d27-dc290d431be5] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:342: "netcat-5788d667bd-s9kkd" [205c0009-1e3f-4f16-8d27-dc290d431be5] Running
net_test.go:152: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 11.008882012s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (11.40s)
=== RUN TestNetworkPlugins/group/flannel/DNS
net_test.go:169: (dbg) Run: kubectl --context flannel-233107 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.31s)
=== RUN TestNetworkPlugins/group/flannel/Localhost
net_test.go:188: (dbg) Run: kubectl --context flannel-233107 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.19s)
=== RUN TestNetworkPlugins/group/flannel/HairPin
net_test.go:238: (dbg) Run: kubectl --context flannel-233107 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.18s)
=== RUN TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p no-preload-234555 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3
=== CONT TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-234555 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3: (2m22.62778656s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (142.63s)
=== RUN TestNetworkPlugins/group/calico/ControllerPod
net_test.go:109: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:342: "calico-node-9scnc" [3d772df9-906c-4a86-8d5c-a63bedb091f9] Running / Ready:ContainersNotReady (containers with unready status: [calico-node]) / ContainersReady:ContainersNotReady (containers with unready status: [calico-node])
net_test.go:109: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 5.024164048s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (5.03s)
=== RUN TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:122: (dbg) Run: out/minikube-linux-amd64 ssh -p calico-233108 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.28s)
=== RUN TestNetworkPlugins/group/calico/NetCatPod
net_test.go:138: (dbg) Run: kubectl --context calico-233108 replace --force -f testdata/netcat-deployment.yaml
net_test.go:152: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:342: "netcat-5788d667bd-gdpd8" [c9c2bbee-87d5-4b46-ac8c-f12b57e06512] Pending
helpers_test.go:342: "netcat-5788d667bd-gdpd8" [c9c2bbee-87d5-4b46-ac8c-f12b57e06512] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E1101 23:46:16.662638 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:46:19.195155 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:46:19.200445 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:46:19.210689 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:46:19.231021 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:46:19.271306 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:46:19.351761 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:46:19.512587 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:46:19.833186 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
helpers_test.go:342: "netcat-5788d667bd-gdpd8" [c9c2bbee-87d5-4b46-ac8c-f12b57e06512] Running
E1101 23:46:20.474153 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:46:21.755342 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:46:24.315624 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
net_test.go:152: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 12.009419845s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (12.47s)
=== RUN TestNetworkPlugins/group/calico/DNS
net_test.go:169: (dbg) Run: kubectl --context calico-233108 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.27s)
=== RUN TestNetworkPlugins/group/calico/Localhost
net_test.go:188: (dbg) Run: kubectl --context calico-233108 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.21s)
=== RUN TestNetworkPlugins/group/calico/HairPin
net_test.go:238: (dbg) Run: kubectl --context calico-233108 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.19s)
E1101 23:57:28.519587 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
E1101 23:57:33.640544 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
E1101 23:57:43.881744 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
=== RUN TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p embed-certs-234627 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3
E1101 23:46:28.341192 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:46:29.435786 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:46:39.676353 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:46:51.697998 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:47:00.156609 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:47:20.943093 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
E1101 23:47:20.948466 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
E1101 23:47:20.958731 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
E1101 23:47:20.979067 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
E1101 23:47:21.019490 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
E1101 23:47:21.099805 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
E1101 23:47:21.260316 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
E1101 23:47:21.581050 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
E1101 23:47:22.221650 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
=== CONT TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-234627 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3: (1m20.292294042s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (80.29s)
=== RUN TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run: kubectl --context old-k8s-version-234448 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:342: "busybox" [b1d8b5db-ce90-4e91-ad59-8fce97727a9f] Pending
E1101 23:47:23.502496 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
helpers_test.go:342: "busybox" [b1d8b5db-ce90-4e91-ad59-8fce97727a9f] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
E1101 23:47:26.062746 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
helpers_test.go:342: "busybox" [b1d8b5db-ce90-4e91-ad59-8fce97727a9f] Running
E1101 23:47:31.183662 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 9.02125269s
start_stop_delete_test.go:196: (dbg) Run: kubectl --context old-k8s-version-234448 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.54s)
=== RUN TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p old-k8s-version-234448 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run: kubectl --context old-k8s-version-234448 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.96s)
=== RUN TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run: out/minikube-linux-amd64 stop -p old-k8s-version-234448 --alsologtostderr -v=3
E1101 23:47:38.583629 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:47:41.116938 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:47:41.424023 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
=== CONT TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p old-k8s-version-234448 --alsologtostderr -v=3: (1m32.45354138s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (92.45s)
=== RUN TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run: kubectl --context embed-certs-234627 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:342: "busybox" [a247bdf5-35e7-45c9-bf6c-846627be46d0] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:342: "busybox" [a247bdf5-35e7-45c9-bf6c-846627be46d0] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 8.031229682s
start_stop_delete_test.go:196: (dbg) Run: kubectl --context embed-certs-234627 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (8.48s)
=== RUN TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-234627 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-234627 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.046144436s)
start_stop_delete_test.go:215: (dbg) Run: kubectl --context embed-certs-234627 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.15s)
=== RUN TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run: out/minikube-linux-amd64 stop -p embed-certs-234627 --alsologtostderr -v=3
E1101 23:48:01.905153 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
=== CONT TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p embed-certs-234627 --alsologtostderr -v=3: (1m32.454945457s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (92.46s)
=== RUN TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run: kubectl --context no-preload-234555 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:342: "busybox" [2ef49dfc-4817-48c8-b2d6-5c7402d21a5c] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:342: "busybox" [2ef49dfc-4817-48c8-b2d6-5c7402d21a5c] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 9.042551883s
start_stop_delete_test.go:196: (dbg) Run: kubectl --context no-preload-234555 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (9.48s)
=== RUN TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p no-preload-234555 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run: kubectl --context no-preload-234555 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.99s)
=== RUN TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run: out/minikube-linux-amd64 stop -p no-preload-234555 --alsologtostderr -v=3
E1101 23:48:42.866000 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
E1101 23:48:56.913775 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:48:56.919051 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:48:56.929320 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:48:56.949856 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:48:56.991057 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:48:57.072223 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:48:57.233236 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:48:57.553819 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:48:58.194735 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:48:59.475647 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:49:02.036419 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:49:03.037879 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
=== CONT TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p no-preload-234555 --alsologtostderr -v=3: (1m32.470277153s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (92.47s)
=== RUN TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-234448 -n old-k8s-version-234448
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-234448 -n old-k8s-version-234448: exit status 7 (107.739075ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p old-k8s-version-234448 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.25s)
=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-234448 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.16.0
E1101 23:49:07.156803 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:49:07.855788 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:49:09.290909 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:49:17.397533 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
=== CONT TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-234448 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.16.0: (7m47.669209245s)
start_stop_delete_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-234448 -n old-k8s-version-234448
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (468.11s)
=== RUN TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-234627 -n embed-certs-234627
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-234627 -n embed-certs-234627: exit status 7 (116.945886ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p embed-certs-234627 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.28s)
=== RUN TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-amd64 start -p embed-certs-234627 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3
E1101 23:49:35.196570 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:49:35.201852 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:49:35.212118 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:49:35.232405 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:49:35.272763 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:49:35.353704 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:49:35.513867 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:49:35.539117 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:49:35.834411 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:49:36.475550 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:49:37.756302 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:49:37.878713 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:49:40.317434 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:49:45.145603 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 23:49:45.437735 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:49:54.739075 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:49:55.678468 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
=== CONT TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-234627 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3: (7m22.406508235s)
start_stop_delete_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-234627 -n embed-certs-234627
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (442.96s)
=== RUN TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-234555 -n no-preload-234555
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-234555 -n no-preload-234555: exit status 7 (162.14156ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p no-preload-234555 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.34s)
=== RUN TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-amd64 start -p no-preload-234555 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3
E1101 23:50:04.786887 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
E1101 23:50:16.158690 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:50:18.839893 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:50:22.424320 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:50:34.455942 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:50:34.461215 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:50:34.471495 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:50:34.491769 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:50:34.532069 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:50:34.612990 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:50:34.773339 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:50:35.093761 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:50:35.734681 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:50:37.015650 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:50:39.576625 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:50:44.697185 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:50:54.937759 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:50:57.119615 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:51:07.608843 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:07.614118 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:07.624410 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:07.644919 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:07.685253 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:07.766092 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:07.926499 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:08.246963 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:08.887854 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:10.168770 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:11.387642 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:51:12.729589 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:15.417984 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:51:17.850724 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:19.195887 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:51:28.091632 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:28.340992 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:51:40.761049 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:51:46.878678 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:51:48.572420 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:51:56.378559 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:52:19.040733 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:52:20.943787 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
E1101 23:52:29.533271 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:52:48.627312 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/custom-flannel-233108/client.crt: no such file or directory
E1101 23:53:18.298790 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:53:51.453479 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:53:52.338186 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:53:56.913442 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:54:07.856399 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:54:09.291626 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:54:24.601668 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:54:35.197048 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
E1101 23:54:45.145340 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 23:54:54.739249 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1101 23:55:02.881745 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-234555 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3: (5m30.163343998s)
start_stop_delete_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-234555 -n no-preload-234555
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (330.73s)
=== RUN TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:342: "kubernetes-dashboard-57bbdc5f89-zjnvl" [5f7bd3fb-9b91-4154-bce6-34b0bf3a019b] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
E1101 23:55:34.456688 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
helpers_test.go:342: "kubernetes-dashboard-57bbdc5f89-zjnvl" [5f7bd3fb-9b91-4154-bce6-34b0bf3a019b] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 16.020848309s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (16.02s)
=== RUN TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:342: "kubernetes-dashboard-57bbdc5f89-zjnvl" [5f7bd3fb-9b91-4154-bce6-34b0bf3a019b] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.010313506s
start_stop_delete_test.go:291: (dbg) Run: kubectl --context no-preload-234555 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.10s)
=== RUN TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run: out/minikube-linux-amd64 ssh -p no-preload-234555 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.34s)
=== RUN TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 pause -p no-preload-234555 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-234555 -n no-preload-234555
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-234555 -n no-preload-234555: exit status 2 (318.827862ms)
-- stdout --
Paused
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-234555 -n no-preload-234555
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-234555 -n no-preload-234555: exit status 2 (320.366658ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 unpause -p no-preload-234555 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-234555 -n no-preload-234555
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-234555 -n no-preload-234555
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.24s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p default-k8s-diff-port-235558 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3
E1101 23:56:02.139833 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/flannel-233107/client.crt: no such file or directory
E1101 23:56:07.609114 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
E1101 23:56:19.195134 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
E1101 23:56:28.340580 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
E1101 23:56:35.293651 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
=== CONT TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-235558 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3: (1m55.571977122s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (115.57s)
=== RUN TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:342: "kubernetes-dashboard-57bbdc5f89-5twgq" [4326435b-ed5a-4eda-961f-294d81a18940] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
=== CONT TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
helpers_test.go:342: "kubernetes-dashboard-57bbdc5f89-5twgq" [4326435b-ed5a-4eda-961f-294d81a18940] Running
=== CONT TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 22.022317327s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (22.02s)
=== RUN TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:342: "kubernetes-dashboard-59d54d6bc8-jjcg7" [1c964a25-0ca2-4366-bd54-e55456a89bf5] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.019438186s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.02s)
=== RUN TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:342: "kubernetes-dashboard-59d54d6bc8-jjcg7" [1c964a25-0ca2-4366-bd54-e55456a89bf5] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.00926996s
start_stop_delete_test.go:291: (dbg) Run: kubectl --context old-k8s-version-234448 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.11s)
=== RUN TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run: out/minikube-linux-amd64 ssh -p old-k8s-version-234448 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.47s)
=== RUN TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 pause -p old-k8s-version-234448 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-234448 -n old-k8s-version-234448
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-234448 -n old-k8s-version-234448: exit status 2 (353.110729ms)
-- stdout --
Paused
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-234448 -n old-k8s-version-234448
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-234448 -n old-k8s-version-234448: exit status 2 (342.172783ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 unpause -p old-k8s-version-234448 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-234448 -n old-k8s-version-234448
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-234448 -n old-k8s-version-234448
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.51s)
=== RUN TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p newest-cni-235710 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3
=== CONT TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-235710 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3: (1m17.770144136s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (77.77s)
=== RUN TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:342: "kubernetes-dashboard-57bbdc5f89-5twgq" [4326435b-ed5a-4eda-961f-294d81a18940] Running
=== CONT TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.010354486s
start_stop_delete_test.go:291: (dbg) Run: kubectl --context embed-certs-234627 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.10s)
=== RUN TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run: out/minikube-linux-amd64 ssh -p embed-certs-234627 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20221004-44d545d1
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.36s)
=== RUN TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 pause -p embed-certs-234627 --alsologtostderr -v=1
=== CONT TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-amd64 pause -p embed-certs-234627 --alsologtostderr -v=1: (1.0095162s)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-234627 -n embed-certs-234627
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-234627 -n embed-certs-234627: exit status 2 (357.8613ms)
-- stdout --
Paused
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-234627 -n embed-certs-234627
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-234627 -n embed-certs-234627: exit status 2 (360.583569ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 unpause -p embed-certs-234627 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-234627 -n embed-certs-234627
E1101 23:57:23.391232 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
E1101 23:57:23.398548 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
E1101 23:57:23.409079 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
E1101 23:57:23.429328 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
E1101 23:57:23.469588 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
E1101 23:57:23.549901 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-234627 -n embed-certs-234627
E1101 23:57:23.711072 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
E1101 23:57:24.032015 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
--- PASS: TestStartStop/group/embed-certs/serial/Pause (3.65s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run: kubectl --context default-k8s-diff-port-235558 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:342: "busybox" [25dbf91a-5447-451a-bd74-c5567f494548] Pending
=== CONT TestStartStop/group/default-k8s-diff-port/serial/DeployApp
helpers_test.go:342: "busybox" [25dbf91a-5447-451a-bd74-c5567f494548] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
=== CONT TestStartStop/group/default-k8s-diff-port/serial/DeployApp
helpers_test.go:342: "busybox" [25dbf91a-5447-451a-bd74-c5567f494548] Running
E1101 23:58:04.362796 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 12.024576455s
start_stop_delete_test.go:196: (dbg) Run: kubectl --context default-k8s-diff-port-235558 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (12.47s)
=== RUN TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:213: (dbg) Run: out/minikube-linux-amd64 logs -p stopped-upgrade-233206
=== CONT TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:213: (dbg) Done: out/minikube-linux-amd64 logs -p stopped-upgrade-233206: (3.691875627s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (3.69s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-diff-port-235558 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run: kubectl --context default-k8s-diff-port-235558 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.86s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run: out/minikube-linux-amd64 stop -p default-k8s-diff-port-235558 --alsologtostderr -v=3
E1101 23:58:18.024162 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
E1101 23:58:18.029440 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
E1101 23:58:18.039671 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
E1101 23:58:18.059942 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
E1101 23:58:18.100212 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
E1101 23:58:18.180554 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
E1101 23:58:18.340828 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
E1101 23:58:18.661423 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
E1101 23:58:19.302113 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
E1101 23:58:20.582276 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
E1101 23:58:23.142985 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
=== CONT TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p default-k8s-diff-port-235558 --alsologtostderr -v=3: (1m31.683501463s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (91.68s)
=== RUN TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)
=== RUN TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-235710 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain
E1101 23:58:28.263560 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.82s)
=== RUN TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run: out/minikube-linux-amd64 stop -p newest-cni-235710 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p newest-cni-235710 --alsologtostderr -v=3: (6.131078215s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (6.13s)
=== RUN TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-235710 -n newest-cni-235710
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-235710 -n newest-cni-235710: exit status 7 (88.223638ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p newest-cni-235710 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.21s)
=== RUN TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-amd64 start -p newest-cni-235710 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3
E1101 23:58:38.504729 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
E1101 23:58:45.323037 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
E1101 23:58:56.913365 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/enable-default-cni-233107/client.crt: no such file or directory
E1101 23:58:58.984864 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
E1101 23:59:07.855369 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/auto-233107/client.crt: no such file or directory
E1101 23:59:09.291507 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/ingress-addon-legacy-225723/client.crt: no such file or directory
E1101 23:59:35.197139 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/bridge-233107/client.crt: no such file or directory
=== CONT TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-235710 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3: (1m33.984168074s)
start_stop_delete_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-235710 -n newest-cni-235710
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (94.45s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-235558 -n default-k8s-diff-port-235558
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-235558 -n default-k8s-diff-port-235558: exit status 7 (83.871938ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p default-k8s-diff-port-235558 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.20s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-amd64 start -p default-k8s-diff-port-235558 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3
E1101 23:59:39.945306 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/no-preload-234555/client.crt: no such file or directory
E1101 23:59:45.145898 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/addons-224602/client.crt: no such file or directory
E1101 23:59:54.739505 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/kindnet-233107/client.crt: no such file or directory
E1102 00:00:07.243765 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/old-k8s-version-234448/client.crt: no such file or directory
=== CONT TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-235558 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.25.3: (6m25.254146807s)
start_stop_delete_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-235558 -n default-k8s-diff-port-235558
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (385.56s)
=== RUN TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)
=== RUN TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)
=== RUN TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run: out/minikube-linux-amd64 ssh -p newest-cni-235710 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20221004-44d545d1
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.39s)
=== RUN TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 pause -p newest-cni-235710 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-amd64 pause -p newest-cni-235710 --alsologtostderr -v=1: (1.853333349s)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-235710 -n newest-cni-235710
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-235710 -n newest-cni-235710: exit status 2 (268.624578ms)
-- stdout --
Paused
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-235710 -n newest-cni-235710
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-235710 -n newest-cni-235710: exit status 2 (257.958336ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 unpause -p newest-cni-235710 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-235710 -n newest-cni-235710
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-235710 -n newest-cni-235710
--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.52s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:342: "kubernetes-dashboard-57bbdc5f89-bcgg2" [3b543b5c-5b5b-4169-b42f-35b1b7946f89] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
E1102 00:06:07.608919 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/calico-233108/client.crt: no such file or directory
helpers_test.go:342: "kubernetes-dashboard-57bbdc5f89-bcgg2" [3b543b5c-5b5b-4169-b42f-35b1b7946f89] Running
E1102 00:06:19.194887 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/cilium-233108/client.crt: no such file or directory
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 18.013368066s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (18.01s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:342: "kubernetes-dashboard-57bbdc5f89-bcgg2" [3b543b5c-5b5b-4169-b42f-35b1b7946f89] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.007584475s
start_stop_delete_test.go:291: (dbg) Run: kubectl --context default-k8s-diff-port-235558 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.07s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run: out/minikube-linux-amd64 ssh -p default-k8s-diff-port-235558 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20221004-44d545d1
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.26s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 pause -p default-k8s-diff-port-235558 --alsologtostderr -v=1
E1102 00:06:28.341104 10671 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15232-3880/.minikube/profiles/functional-225352/client.crt: no such file or directory
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-235558 -n default-k8s-diff-port-235558
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-235558 -n default-k8s-diff-port-235558: exit status 2 (261.783378ms)
-- stdout --
Paused
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-235558 -n default-k8s-diff-port-235558
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-235558 -n default-k8s-diff-port-235558: exit status 2 (253.820867ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 unpause -p default-k8s-diff-port-235558 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-235558 -n default-k8s-diff-port-235558
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-235558 -n default-k8s-diff-port-235558
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (2.50s)
=== RUN TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:121: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)
=== RUN TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:140: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)
=== RUN TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:156: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)
=== RUN TestDownloadOnly/v1.25.3/cached-images
aaa_download_only_test.go:121: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.25.3/cached-images (0.00s)
=== RUN TestDownloadOnly/v1.25.3/binaries
aaa_download_only_test.go:140: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.25.3/binaries (0.00s)
=== RUN TestDownloadOnly/v1.25.3/kubectl
aaa_download_only_test.go:156: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.25.3/kubectl (0.00s)
=== RUN TestDownloadOnlyKic
aaa_download_only_test.go:214: skipping, only for docker or podman driver
--- SKIP: TestDownloadOnlyKic (0.00s)
=== RUN TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm
=== CONT TestAddons/parallel/Olm
=== CONT TestAddons/parallel/Olm
addons_test.go:451: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)
=== RUN TestDockerFlags
docker_test.go:35: skipping: only runs with docker container runtime, currently testing containerd
--- SKIP: TestDockerFlags (0.00s)
=== RUN TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)
=== RUN TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)
=== RUN TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv
=== CONT TestFunctional/parallel/DockerEnv
functional_test.go:456: only validate docker env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)
=== RUN TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv
=== CONT TestFunctional/parallel/PodmanEnv
functional_test.go:543: only validate podman env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/StartTunnel
=== CONT TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:88: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.01s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/WaitService
functional_test_tunnel_test.go:88: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/WaitService (0.01s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:88: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.02s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:88: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.01s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:88: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.01s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
=== CONT TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:88: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.01s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
=== CONT TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:88: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.01s)
=== RUN TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)
=== RUN TestKicCustomNetwork
kic_custom_network_test.go:34: only runs with docker driver
--- SKIP: TestKicCustomNetwork (0.00s)
=== RUN TestKicExistingNetwork
kic_custom_network_test.go:73: only runs with docker driver
--- SKIP: TestKicExistingNetwork (0.00s)
=== RUN TestKicCustomSubnet
kic_custom_network_test.go:102: only runs with docker/podman driver
--- SKIP: TestKicCustomSubnet (0.00s)
=== RUN TestChangeNoneUser
none_test.go:38: Only test none driver.
--- SKIP: TestChangeNoneUser (0.00s)
=== RUN TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)
=== RUN TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing containerd container runtime
--- SKIP: TestSkaffold (0.00s)
=== RUN TestInsufficientStorage
status_test.go:38: only runs with docker driver
--- SKIP: TestInsufficientStorage (0.00s)
=== RUN TestMissingContainerUpgrade
version_upgrade_test.go:291: This test is only for Docker
--- SKIP: TestMissingContainerUpgrade (0.00s)
=== RUN TestNetworkPlugins/group/kubenet
net_test.go:91: Skipping the test as containerd container runtimes requires CNI
helpers_test.go:175: Cleaning up "kubenet-233107" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p kubenet-233107
--- SKIP: TestNetworkPlugins/group/kubenet (0.25s)
=== RUN TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts
=== CONT TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-235558" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p disable-driver-mounts-235558
--- SKIP: TestStartStop/group/disable-driver-mounts (0.23s)